Skip to content

Update blazesym to v0.2.0-rc.3. #1046

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

Update blazesym to v0.2.0-rc.3. #1046

wants to merge 1 commit into from

Conversation

hoolioh
Copy link
Contributor

@hoolioh hoolioh commented Apr 30, 2025

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Apr 30, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-04-30 11:54:35

Comparing candidate commit df04a91 in PR branch julio/update-blazesym-dependency with baseline commit a4c43a4 in branch main.

Found 6 performance improvements and 14 performance regressions! Performance is the same for 32 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/ 3782-8224-6310-005

  • 🟥 execution_time [+4.458µs; +4.647µs] or [+5.749%; +5.993%]
  • 🟥 throughput [-730905.033op/s; -700628.602op/s] or [-5.668%; -5.433%]

scenario:credit_card/is_card_number/ 378282246310005

  • 🟥 execution_time [+5.340µs; +5.494µs] or [+7.471%; +7.687%]
  • 🟥 throughput [-1000670.104op/s; -971624.950op/s] or [-7.152%; -6.944%]

scenario:credit_card/is_card_number/378282246310005

  • 🟥 execution_time [+4.992µs; +5.153µs] or [+7.363%; +7.601%]
  • 🟥 throughput [-1043082.729op/s; -1010430.537op/s] or [-7.072%; -6.851%]

scenario:credit_card/is_card_number/x371413321323331

  • 🟥 execution_time [+399.429ns; +402.433ns] or [+6.618%; +6.667%]
  • 🟥 throughput [-10360313.778op/s; -10280128.736op/s] or [-6.253%; -6.205%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟥 execution_time [+404.134ns; +407.058ns] or [+6.695%; +6.744%]
  • 🟥 throughput [-10471358.267op/s; -10392385.122op/s] or [-6.321%; -6.273%]

scenario:normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...

  • 🟥 execution_time [+21.352µs; +21.598µs] or [+10.869%; +10.994%]
  • 🟥 throughput [-504660.380op/s; -498636.723op/s] or [-9.914%; -9.796%]

scenario:normalization/normalize_name/normalize_name/bad-name

  • 🟩 execution_time [-1.020µs; -0.998µs] or [-5.481%; -5.362%]
  • 🟩 throughput [+3045608.688op/s; +3111236.770op/s] or [+5.670%; +5.793%]

scenario:normalization/normalize_name/normalize_name/good

  • 🟩 execution_time [-648.071ns; -615.996ns] or [-5.917%; -5.624%]
  • 🟩 throughput [+5451873.629op/s; +5748680.520op/s] or [+5.972%; +6.297%]

scenario:normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...

  • 🟩 execution_time [-64.815µs; -64.617µs] or [-12.145%; -12.107%]
  • 🟩 throughput [+258153.032op/s; +258972.554op/s] or [+13.777%; +13.821%]

scenario:normalization/normalize_service/normalize_service/[empty string]

  • 🟥 execution_time [+2.531µs; +2.569µs] or [+6.794%; +6.898%]
  • 🟥 throughput [-1734025.436op/s; -1706750.997op/s] or [-6.459%; -6.358%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz df04a91 1746013368 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.247µs 3.155µs ± 1.423µs 2.991µs ± 0.021µs 3.011µs 3.121µs 13.860µs 14.968µs 400.40% 7.508 56.823 45.01% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.957µs; 3.352µs] or [-6.253%; +6.253%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz df04a91 1746013368 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 151.012µs 151.647µs ± 0.306µs 151.611µs ± 0.171µs 151.790µs 152.187µs 152.655µs 153.021µs 0.93% 1.190 2.881 0.20% 0.022µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [151.604µs; 151.689µs] or [-0.028%; +0.028%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz df04a91 1746013368 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 216.955µs 217.928µs ± 0.489µs 217.899µs ± 0.306µs 218.210µs 218.528µs 218.832µs 221.097µs 1.47% 1.935 10.437 0.22% 0.035µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4522895.284op/s 4588699.929op/s ± 10259.030op/s 4589275.872op/s ± 6434.267op/s 4595454.433op/s 4603457.759op/s 4606575.014op/s 4609258.050op/s 0.44% -1.878 10.019 0.22% 725.423op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.533µs 17.609µs ± 0.042µs 17.602µs ± 0.024µs 17.630µs 17.700µs 17.729µs 17.754µs 0.86% 1.003 1.323 0.24% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 56325521.757op/s 56789199.193op/s ± 135785.830op/s 56811549.670op/s ± 78818.049op/s 56882760.210op/s 56979380.360op/s 57016056.473op/s 57033856.064op/s 0.39% -0.986 1.281 0.24% 9601.508op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.195µs 10.322µs ± 0.110µs 10.253µs ± 0.038µs 10.444µs 10.481µs 10.502µs 10.506µs 2.46% 0.404 -1.697 1.06% 0.008µs 1 200
normalization/normalize_name/normalize_name/good throughput 95184465.314op/s 96896013.654op/s ± 1027007.968op/s 97529525.027op/s ± 359253.162op/s 97774054.237op/s 97916080.470op/s 98059929.948op/s 98083625.650op/s 0.57% -0.400 -1.702 1.06% 72620.430op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [217.860µs; 217.996µs] or [-0.031%; +0.031%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4587278.126op/s; 4590121.732op/s] or [-0.031%; +0.031%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.603µs; 17.615µs] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [56770380.583op/s; 56808017.804op/s] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.306µs; 10.337µs] or [-0.148%; +0.148%] None None None
normalization/normalize_name/normalize_name/good throughput [96753680.227op/s; 97038347.081op/s] or [-0.147%; +0.147%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz df04a91 1746013368 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.406µs 2.433µs ± 0.021µs 2.431µs ± 0.012µs 2.441µs 2.488µs 2.495µs 2.515µs 3.44% 1.611 2.769 0.84% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.431µs; 2.436µs] or [-0.117%; +0.117%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz df04a91 1746013368 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 5.915ms 5.928ms ± 0.008ms 5.927ms ± 0.004ms 5.931ms 5.938ms 5.967ms 5.998ms 1.19% 4.376 29.515 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [5.927ms; 5.929ms] or [-0.020%; +0.020%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz df04a91 1746013368 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.523µs 24.912µs ± 10.709µs 17.647µs ± 0.095µs 34.291µs 43.045µs 45.028µs 91.393µs 417.91% 2.017 7.462 42.88% 0.757µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.427µs; 26.396µs] or [-5.958%; +5.958%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz df04a91 1746013368 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.890µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.914µs 3.918µs 3.919µs 3.920µs 0.18% -1.432 10.345 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 255124006.530op/s 255591161.004op/s ± 212013.337op/s 255590019.617op/s ± 130524.993op/s 255721448.642op/s 255871933.159op/s 255923635.402op/s 257073052.883op/s 0.58% 1.458 10.549 0.08% 14991.607op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 81.696µs 82.099µs ± 0.287µs 82.033µs ± 0.186µs 82.281µs 82.657µs 82.938µs 83.529µs 1.82% 1.276 2.630 0.35% 0.020µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11971884.128op/s 12180592.753op/s ± 42379.709op/s 12190171.065op/s ± 27614.836op/s 12214490.973op/s 12228430.735op/s 12237494.779op/s 12240544.355op/s 0.41% -1.245 2.468 0.35% 2996.698op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 76.424µs 76.891µs ± 0.281µs 76.845µs ± 0.166µs 77.013µs 77.467µs 77.685µs 78.072µs 1.60% 1.183 1.768 0.37% 0.020µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12808768.316op/s 13005579.041op/s ± 47390.447op/s 13013289.860op/s ± 28159.032op/s 13040650.050op/s 13063082.817op/s 13072161.853op/s 13084966.682op/s 0.55% -1.158 1.674 0.36% 3351.011op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.896µs 3.912µs ± 0.003µs 3.911µs ± 0.002µs 3.914µs 3.917µs 3.919µs 3.920µs 0.23% -0.175 2.279 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255084786.512op/s 255652337.372op/s ± 204014.054op/s 255668949.009op/s ± 131810.947op/s 255779547.439op/s 255946017.875op/s 255986416.298op/s 256667662.755op/s 0.39% 0.186 2.315 0.08% 14425.972op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 72.003µs 72.873µs ± 0.419µs 72.877µs ± 0.304µs 73.167µs 73.557µs 73.785µs 73.988µs 1.53% 0.160 -0.504 0.57% 0.030µs 1 200
credit_card/is_card_number/378282246310005 throughput 13515672.156op/s 13722933.146op/s ± 78844.658op/s 13721841.764op/s ± 57188.056op/s 13781853.531op/s 13851183.397op/s 13878985.318op/s 13888278.062op/s 1.21% -0.135 -0.518 0.57% 5575.159op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.877µs 52.154µs ± 0.113µs 52.147µs ± 0.075µs 52.226µs 52.355µs 52.395µs 52.647µs 0.96% 0.587 1.189 0.22% 0.008µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 18994310.610op/s 19174158.910op/s ± 41610.042op/s 19176500.158op/s ± 27504.465op/s 19203173.326op/s 19237131.993op/s 19253608.078op/s 19276268.484op/s 0.52% -0.569 1.138 0.22% 2942.274op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.428µs 6.437µs ± 0.005µs 6.436µs ± 0.004µs 6.440µs 6.445µs 6.447µs 6.449µs 0.20% 0.281 -0.720 0.08% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 155055977.303op/s 155359398.979op/s ± 120502.455op/s 155369299.027op/s ± 85303.935op/s 155449693.382op/s 155544991.265op/s 155563521.686op/s 155568760.992op/s 0.13% -0.278 -0.722 0.08% 8520.810op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.895µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.915µs 3.917µs 3.919µs 3.922µs 0.26% -0.312 2.961 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254975487.153op/s 255619811.548op/s ± 217738.471op/s 255643681.697op/s ± 137208.569op/s 255760736.862op/s 255921315.639op/s 255973965.381op/s 256770708.176op/s 0.44% 0.325 3.014 0.08% 15396.435op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.920µs 64.195µs ± 0.122µs 64.190µs ± 0.057µs 64.249µs 64.361µs 64.626µs 64.753µs 0.88% 1.178 4.434 0.19% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15443319.799op/s 15577687.706op/s ± 29466.589op/s 15578769.257op/s ± 13740.290op/s 15591795.208op/s 15625942.268op/s 15638356.266op/s 15644442.733op/s 0.42% -1.149 4.332 0.19% 2083.603op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.148µs 58.264µs ± 0.146µs 58.223µs ± 0.034µs 58.271µs 58.567µs 58.854µs 59.061µs 1.44% 3.198 11.060 0.25% 0.010µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16931533.603op/s 17163218.885op/s ± 42665.361op/s 17175337.075op/s ± 10046.757op/s 17184662.689op/s 17192538.954op/s 17195529.300op/s 17197508.081op/s 0.13% -3.177 10.900 0.25% 3016.897op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.917µs 3.920µs 3.923µs 0.27% -0.538 4.600 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254886021.490op/s 255581254.842op/s ± 204856.177op/s 255586826.156op/s ± 138427.982op/s 255724421.683op/s 255871229.079op/s 255933924.816op/s 256751551.655op/s 0.46% 0.553 4.672 0.08% 14485.519op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.541µs 54.741µs ± 0.215µs 54.652µs ± 0.066µs 54.813µs 55.125µs 55.538µs 55.664µs 1.85% 1.754 3.071 0.39% 0.015µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17964943.033op/s 18268136.257op/s ± 71421.076op/s 18297749.378op/s ± 22098.940op/s 18316325.803op/s 18326301.819op/s 18331480.875op/s 18334702.091op/s 0.20% -1.731 2.941 0.39% 5050.233op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.919µs 52.147µs ± 0.110µs 52.144µs ± 0.081µs 52.220µs 52.338µs 52.448µs 52.520µs 0.72% 0.509 0.250 0.21% 0.008µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19040295.712op/s 19176671.324op/s ± 40459.370op/s 19177587.159op/s ± 29793.615op/s 19208995.095op/s 19232605.342op/s 19250378.574op/s 19260746.468op/s 0.43% -0.497 0.225 0.21% 2860.909op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.435µs 6.442µs ± 0.003µs 6.441µs ± 0.002µs 6.443µs 6.447µs 6.448µs 6.468µs 0.42% 2.940 20.376 0.05% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 154606143.833op/s 155240118.621op/s ± 78213.210op/s 155249353.790op/s ± 38101.629op/s 155287187.742op/s 155330846.712op/s 155358418.788op/s 155391981.774op/s 0.09% -2.920 20.158 0.05% 5530.509op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ throughput [255561777.994op/s; 255620544.013op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.059µs; 82.139µs] or [-0.048%; +0.048%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12174719.333op/s; 12186466.173op/s] or [-0.048%; +0.048%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [76.852µs; 76.930µs] or [-0.051%; +0.051%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12999011.181op/s; 13012146.902op/s] or [-0.051%; +0.051%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.912µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255624062.986op/s; 255680611.757op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [72.815µs; 72.931µs] or [-0.080%; +0.080%] None None None
credit_card/is_card_number/378282246310005 throughput [13712006.035op/s; 13733860.257op/s] or [-0.080%; +0.080%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.138µs; 52.169µs] or [-0.030%; +0.030%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19168392.158op/s; 19179925.661op/s] or [-0.030%; +0.030%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.436µs; 6.437µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/x371413321323331 throughput [155342698.498op/s; 155376099.460op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ throughput [255589635.090op/s; 255649988.006op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.178µs; 64.211µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15573603.920op/s; 15581771.492op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.244µs; 58.285µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17157305.876op/s; 17169131.893op/s] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255552863.746op/s; 255609645.938op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.711µs; 54.771µs] or [-0.055%; +0.055%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18258237.982op/s; 18278034.531op/s] or [-0.054%; +0.054%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.132µs; 52.162µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19171064.044op/s; 19182278.603op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.441µs; 6.442µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155229279.022op/s; 155250958.220op/s] or [-0.007%; +0.007%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz df04a91 1746013368 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.470µs 33.404µs ± 1.241µs 32.636µs ± 0.074µs 35.065µs 35.495µs 35.800µs 35.870µs 9.91% 0.942 -1.042 3.71% 0.088µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.232µs; 33.577µs] or [-0.515%; +0.515%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz df04a91 1746013368 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 246.534ns 254.637ns ± 10.930ns 248.952ns ± 1.509ns 255.229ns 281.981ns 284.672ns 288.429ns 15.86% 1.610 1.283 4.28% 0.773ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [253.122ns; 256.151ns] or [-0.595%; +0.595%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz df04a91 1746013368 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.942µs 5.009µs ± 0.056µs 4.987µs ± 0.024µs 5.037µs 5.111µs 5.115µs 5.116µs 2.59% 0.854 -0.842 1.11% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.001µs; 5.017µs] or [-0.154%; +0.154%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz df04a91 1746013368 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 72.693ms 73.244ms ± 0.572ms 73.174ms ± 0.208ms 73.361ms 73.806ms 74.216ms 78.337ms 7.06% 6.027 48.185 0.78% 0.040ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [73.165ms; 73.323ms] or [-0.108%; +0.108%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz df04a91 1746013368 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 466.714µs 468.979µs ± 0.543µs 468.910µs ± 0.302µs 469.251µs 469.851µs 470.232µs 472.677µs 0.80% 1.595 10.832 0.12% 0.038µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 2115609.602op/s 2132296.105op/s ± 2466.503op/s 2132604.447op/s ± 1371.895op/s 2133762.841op/s 2135250.978op/s 2135646.231op/s 2142641.509op/s 0.47% -1.560 10.623 0.12% 174.408op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 449.525µs 450.307µs ± 0.557µs 450.256µs ± 0.244µs 450.502µs 450.961µs 451.182µs 456.357µs 1.35% 6.523 67.932 0.12% 0.039µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2191268.125op/s 2220710.653op/s ± 2723.136op/s 2220959.730op/s ± 1203.657op/s 2222130.745op/s 2223408.163op/s 2223987.265op/s 2224571.122op/s 0.16% -6.423 66.472 0.12% 192.555op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 180.340µs 181.183µs ± 0.327µs 181.190µs ± 0.242µs 181.422µs 181.723µs 181.935µs 182.028µs 0.46% 0.099 -0.487 0.18% 0.023µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5493666.205op/s 5519299.474op/s ± 9966.973op/s 5519082.502op/s ± 7363.183op/s 5526600.438op/s 5533796.116op/s 5540531.797op/s 5545085.262op/s 0.47% -0.091 -0.488 0.18% 704.771op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 39.700µs 39.800µs ± 0.054µs 39.797µs ± 0.033µs 39.831µs 39.875µs 39.907µs 40.154µs 0.90% 1.630 8.697 0.14% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 24904056.753op/s 25125559.653op/s ± 34212.006op/s 25127787.437op/s ± 21090.353op/s 25146181.714op/s 25172941.460op/s 25185842.494op/s 25189145.893op/s 0.24% -1.598 8.461 0.14% 2419.154op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.199µs 48.297µs ± 0.121µs 48.288µs ± 0.033µs 48.314µs 48.372µs 48.467µs 49.847µs 3.23% 10.627 132.982 0.25% 0.009µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20061232.352op/s 20705546.801op/s ± 50585.755op/s 20709215.329op/s ± 13952.934op/s 20724239.153op/s 20738021.408op/s 20744158.302op/s 20747166.774op/s 0.18% -10.462 130.105 0.24% 3576.953op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [468.903µs; 469.054µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2131954.272op/s; 2132637.939op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [450.230µs; 450.384µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2220333.252op/s; 2221088.053op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [181.138µs; 181.228µs] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5517918.147op/s; 5520680.800op/s] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [39.793µs; 39.808µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [25120818.198op/s; 25130301.108op/s] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.280µs; 48.313µs] or [-0.035%; +0.035%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20698536.101op/s; 20712557.500op/s] or [-0.034%; +0.034%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz df04a91 1746013368 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 65.882µs 66.081µs ± 0.212µs 66.063µs ± 0.045µs 66.103µs 66.227µs 66.569µs 68.521µs 3.72% 8.481 89.397 0.32% 0.015µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [66.052µs; 66.111µs] or [-0.045%; +0.045%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Apr 30, 2025 •
edited
Loading

Codecov Report

Attention: Patch coverage is 0% with 2 lines in your changes missing coverage. Please review.

Project coverage is 71.29%. Comparing base (a4c43a4) to head (df04a91).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1046      +/-   ##
==========================================
+ Coverage   71.25%   71.29%   +0.04%     
==========================================
  Files         329      329              
  Lines       49153    49153              
==========================================
+ Hits        35022    35045      +23     
+ Misses      14131    14108      -23
Components Coverage Δ
crashtracker 42.82% <0.00%> (+0.02%) ⬆️
crashtracker-ffi 6.30% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 90.78% <ø> (ø)
data-pipeline-ffi 89.02% <ø> (ø)
ddcommon 78.29% <ø> (ø)
ddcommon-ffi 66.37% <ø> (ø)
ddtelemetry 60.19% <ø> (ø)
ddtelemetry-ffi 21.32% <ø> (ø)
dogstatsd-client 82.57% <ø> (ø)
ipc 82.54% <ø> (ø)
profiling 77.49% <ø> (ø)
profiling-ffi 62.12% <ø> (ø)
sidecar 41.59% <ø> (+0.15%) ⬆️
sidecar-ffi 5.54% <ø> (+1.16%) ⬆️
spawn-worker 54.37% <ø> (ø)
tinybytes 90.54% <ø> (ø)
trace-normalization 98.24% <ø> (ø)
trace-obfuscation 94.16% <ø> (ø)
trace-protobuf 78.50% <ø> (ø)
trace-utils 89.33% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@hoolioh hoolioh force-pushed the julio/update-blazesym-dependency branch from 69ffa1d to df04a91 Compare April 30, 2025 11:43
@r1viollet
Copy link
Contributor

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 20.31 MB 21.18 MB +4.27% (+889.91 KB) ⚠️
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.03 MB 8.33 MB +3.69% (+303.95 KB) ⚠️
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 66.04 MB 68.11 MB +3.13% (+2.06 MB) ⚠️
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 8.00 MB 8.30 MB +3.77% (+309.28 KB) ⚠️
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 22.70 MB 23.73 MB +4.56% (+1.03 MB) ⚠️
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 72.62 MB 75.06 MB +3.36% (+2.44 MB) ⚠️
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 16.71 MB 16.71 MB +0% (+512 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 61.92 KB 61.92 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 112.73 MB 112.73 MB +0% (+8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 632.45 MB 631.95 MB --.07% (-516.34 KB) 💪
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 4.99 MB 4.99 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 61.92 KB 61.92 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 15.88 MB 15.88 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 26.43 MB 26.43 MB +0% (+2.15 KB) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 14.12 MB 14.12 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 62.87 KB 62.87 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 114.47 MB 114.45 MB --.01% (-16.00 KB) 💪
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 624.24 MB 624.48 MB +.03% (+245.78 KB) 🔍
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 3.78 MB 3.78 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 62.87 KB 62.87 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 16.49 MB 16.49 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 24.34 MB 24.34 MB -0% (-18 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 57.52 MB 59.37 MB +3.22% (+1.85 MB) ⚠️
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.43 MB 8.69 MB +3.14% (+271.55 KB) ⚠️
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 18.71 MB 19.50 MB +4.21% (+807.68 KB) ⚠️
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 68.60 MB 70.71 MB +3.08% (+2.11 MB) ⚠️
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 8.42 MB 8.71 MB +3.33% (+287.75 KB) ⚠️
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 20.89 MB 21.81 MB +4.38% (+938.25 KB) ⚠️

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
crashtracker
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@hoolioh @codecov-commenter @r1viollet