Skip to content

Fix integration test. #984

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Fix integration test. #984

wants to merge 1 commit into from

Conversation

hoolioh
Copy link
Contributor

@hoolioh hoolioh commented Mar 28, 2025

What does this PR do?

Fix integration test due to a missing field in the snapshot.

@hoolioh hoolioh requested review from a team as code owners March 28, 2025 11:52
@pr-commenter
Copy link

pr-commenter bot commented Mar 28, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-03-28 13:50:19

Comparing candidate commit 663b3bc in PR branch julio/fix-integration-test with baseline commit 1faf409 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bc 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 147.164µs 148.223µs ± 0.941µs 148.089µs ± 0.420µs 148.599µs 149.317µs 150.629µs 157.708µs 6.50% 5.543 50.429 0.63% 0.067µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [148.093µs; 148.354µs] or [-0.088%; +0.088%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bc 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.901µs 3.915µs ± 0.003µs 3.915µs ± 0.001µs 3.917µs 3.919µs 3.921µs 3.921µs 0.14% -0.926 3.443 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 255038075.467op/s 255410725.681op/s ± 179728.851op/s 255404827.151op/s ± 94728.251op/s 255499382.873op/s 255703978.352op/s 255911949.302op/s 256355745.490op/s 0.37% 0.936 3.487 0.07% 12708.749op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 81.716µs 82.163µs ± 0.554µs 82.013µs ± 0.134µs 82.256µs 82.829µs 84.253µs 87.630µs 6.85% 5.895 48.926 0.67% 0.039µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11411638.375op/s 12171532.584op/s ± 79047.848op/s 12193148.061op/s ± 19977.089op/s 12208371.903op/s 12222935.056op/s 12228892.273op/s 12237441.677op/s 0.36% -5.584 44.447 0.65% 5589.527op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 76.330µs 76.747µs ± 0.358µs 76.630µs ± 0.187µs 76.960µs 77.394µs 77.701µs 78.461µs 2.39% 1.623 3.914 0.46% 0.025µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12745145.826op/s 13030105.366op/s ± 60257.500op/s 13049639.484op/s ± 31965.164op/s 13075833.898op/s 13090690.960op/s 13100057.942op/s 13100936.717op/s 0.39% -1.578 3.650 0.46% 4260.849op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.897µs 3.915µs ± 0.003µs 3.916µs ± 0.001µs 3.917µs 3.919µs 3.921µs 3.925µs 0.23% -1.459 9.443 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254807445.286op/s 255398090.382op/s ± 185788.331op/s 255392427.636op/s ± 94377.146op/s 255479319.944op/s 255687845.714op/s 255879807.670op/s 256633122.152op/s 0.49% 1.480 9.573 0.07% 13137.219op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 71.956µs 72.359µs ± 0.480µs 72.240µs ± 0.210µs 72.489µs 73.101µs 74.186µs 75.749µs 4.86% 3.348 17.148 0.66% 0.034µs 1 200
credit_card/is_card_number/378282246310005 throughput 13201521.993op/s 13820518.748op/s ± 89692.874op/s 13842783.955op/s ± 40259.649op/s 13880331.224op/s 13891429.544op/s 13896187.011op/s 13897367.839op/s 0.39% -3.196 15.749 0.65% 6342.244op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.849µs 52.153µs ± 0.104µs 52.152µs ± 0.075µs 52.227µs 52.319µs 52.372µs 52.387µs 0.45% -0.125 -0.305 0.20% 0.007µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19088671.053op/s 19174286.591op/s ± 38255.390op/s 19174772.710op/s ± 27454.689op/s 19199856.001op/s 19237184.323op/s 19258416.996op/s 19286592.945op/s 0.58% 0.135 -0.299 0.20% 2705.065op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.430µs 6.443µs ± 0.005µs 6.443µs ± 0.003µs 6.446µs 6.450µs 6.453µs 6.461µs 0.28% -0.000 0.533 0.08% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 154778183.018op/s 155211170.893op/s ± 119191.326op/s 155209266.009op/s ± 72600.553op/s 155285305.983op/s 155426159.078op/s 155485118.775op/s 155530346.456op/s 0.21% 0.006 0.529 0.08% 8428.100op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.899µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.920µs 3.923µs 3.938µs 0.59% 0.910 10.005 0.09% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 253939416.657op/s 255418730.003op/s ± 227087.764op/s 255430753.897op/s ± 123962.492op/s 255534928.867op/s 255748664.712op/s 255927809.398op/s 256466850.806op/s 0.41% -0.880 9.874 0.09% 16057.530op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.011µs 64.294µs ± 0.141µs 64.258µs ± 0.054µs 64.332µs 64.591µs 64.745µs 65.104µs 1.32% 1.924 6.132 0.22% 0.010µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15360114.941op/s 15553508.223op/s ± 33897.773op/s 15562362.427op/s ± 13045.423op/s 15571937.035op/s 15587043.037op/s 15612542.287op/s 15622347.768op/s 0.39% -1.895 5.956 0.22% 2396.934op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.175µs 58.303µs ± 0.075µs 58.290µs ± 0.022µs 58.312µs 58.463µs 58.624µs 58.678µs 0.67% 2.742 9.131 0.13% 0.005µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17042126.850op/s 17151679.910op/s ± 21887.046op/s 17155713.384op/s ± 6582.767op/s 17162183.986op/s 17173402.607op/s 17183995.486op/s 17189504.089op/s 0.20% -2.729 9.058 0.13% 1547.648op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.903µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.920µs 3.922µs 3.928µs 0.32% -0.183 1.716 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254602449.983op/s 255428661.600op/s ± 213933.297op/s 255422428.271op/s ± 123820.577op/s 255542170.847op/s 255816643.539op/s 255940016.685op/s 256243798.875op/s 0.32% 0.192 1.716 0.08% 15127.369op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.546µs 54.785µs ± 0.218µs 54.684µs ± 0.052µs 54.835µs 55.222µs 55.552µs 55.615µs 1.70% 1.749 2.515 0.40% 0.015µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17980799.454op/s 18253588.134op/s ± 72070.545op/s 18286720.184op/s ± 17540.134op/s 18300139.539op/s 18308588.742op/s 18326722.323op/s 18333074.700op/s 0.25% -1.732 2.431 0.39% 5096.157op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.925µs 52.146µs ± 0.094µs 52.140µs ± 0.061µs 52.215µs 52.291µs 52.331µs 52.601µs 0.88% 0.335 1.953 0.18% 0.007µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19010917.415op/s 19176875.373op/s ± 34499.285op/s 19179035.397op/s ± 22412.687op/s 19196977.917op/s 19236558.025op/s 19256977.622op/s 19258586.546op/s 0.41% -0.315 1.882 0.18% 2439.468op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.429µs 6.443µs ± 0.004µs 6.443µs ± 0.003µs 6.446µs 6.449µs 6.452µs 6.455µs 0.19% -0.355 0.623 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 154908848.819op/s 155207002.632op/s ± 105317.820op/s 155208575.274op/s ± 60868.986op/s 155265257.994op/s 155421613.348op/s 155460017.563op/s 155542255.178op/s 0.21% 0.360 0.628 0.07% 7447.094op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.915µs; 3.916µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255385816.991op/s; 255435634.371op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.086µs; 82.239µs] or [-0.093%; +0.093%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12160577.313op/s; 12182487.856op/s] or [-0.090%; +0.090%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [76.697µs; 76.797µs] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13021754.257op/s; 13038456.476op/s] or [-0.064%; +0.064%] None None None
credit_card/is_card_number/37828224631 execution_time [3.915µs; 3.916µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255372341.906op/s; 255423838.858op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [72.293µs; 72.426µs] or [-0.092%; +0.092%] None None None
credit_card/is_card_number/378282246310005 throughput [13808088.179op/s; 13832949.318op/s] or [-0.090%; +0.090%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.139µs; 52.168µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19168984.762op/s; 19179588.420op/s] or [-0.028%; +0.028%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.442µs; 6.444µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/x371413321323331 throughput [155194652.122op/s; 155227689.665op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.915µs; 3.916µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ throughput [255387257.823op/s; 255450202.183op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.275µs; 64.314µs] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15548810.318op/s; 15558206.129op/s] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.293µs; 58.314µs] or [-0.018%; +0.018%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17148646.576op/s; 17154713.244op/s] or [-0.018%; +0.018%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.915µs; 3.915µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255399012.503op/s; 255458310.698op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.754µs; 54.815µs] or [-0.055%; +0.055%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18243599.849op/s; 18263576.418op/s] or [-0.055%; +0.055%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.133µs; 52.159µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19172094.104op/s; 19181656.642op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.442µs; 6.444µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155192406.595op/s; 155221598.669op/s] or [-0.009%; +0.009%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bc 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 246.910ns 257.128ns ± 10.864ns 251.186ns ± 2.543ns 261.512ns 282.980ns 286.066ns 288.563ns 14.88% 1.290 0.475 4.21% 0.768ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [255.622ns; 258.634ns] or [-0.586%; +0.586%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bc 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 502.753µs 504.463µs ± 0.989µs 504.275µs ± 0.551µs 505.041µs 505.928µs 506.171µs 512.584µs 1.65% 2.915 20.939 0.20% 0.070µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1950899.966op/s 1982314.712op/s ± 3864.886op/s 1983044.310op/s ± 2168.501op/s 1984759.200op/s 1986873.861op/s 1987820.869op/s 1989048.080op/s 0.30% -2.832 20.047 0.19% 273.289op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 454.025µs 455.309µs ± 0.553µs 455.267µs ± 0.386µs 455.733µs 456.183µs 456.485µs 456.791µs 0.33% 0.044 -0.425 0.12% 0.039µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2189184.988op/s 2196311.701op/s ± 2665.413op/s 2196512.531op/s ± 1862.446op/s 2198069.771op/s 2200716.030op/s 2202091.393op/s 2202523.585op/s 0.27% -0.038 -0.427 0.12% 188.473op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 177.294µs 177.734µs ± 0.516µs 177.665µs ± 0.086µs 177.780µs 177.952µs 178.072µs 182.723µs 2.85% 8.848 82.212 0.29% 0.036µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5472766.247op/s 5626446.554op/s ± 15915.701op/s 5628576.033op/s ± 2734.382op/s 5630627.924op/s 5633980.333op/s 5639316.439op/s 5640349.575op/s 0.21% -8.796 81.560 0.28% 1125.410op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.559µs 37.657µs ± 0.042µs 37.657µs ± 0.026µs 37.683µs 37.720µs 37.753µs 37.835µs 0.47% 0.422 1.109 0.11% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26430835.534op/s 26555654.009op/s ± 29521.973op/s 26555766.166op/s ± 18413.597op/s 26573691.965op/s 26603858.589op/s 26614981.997op/s 26624994.516op/s 0.26% -0.412 1.083 0.11% 2087.519op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.097µs 48.321µs ± 0.206µs 48.259µs ± 0.156µs 48.528µs 48.637µs 48.701µs 48.815µs 1.15% 0.312 -1.459 0.42% 0.015µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20485460.388op/s 20695322.584op/s ± 88057.081op/s 20721665.002op/s ± 67168.425op/s 20786491.156op/s 20789439.203op/s 20790731.706op/s 20791308.045op/s 0.34% -0.307 -1.467 0.42% 6226.576op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [504.326µs; 504.600µs] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1981779.076op/s; 1982850.348op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [455.233µs; 455.386µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2195942.300op/s; 2196681.102op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [177.662µs; 177.805µs] or [-0.040%; +0.040%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5624240.791op/s; 5628652.317op/s] or [-0.039%; +0.039%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.651µs; 37.663µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26551562.548op/s; 26559745.471op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.292µs; 48.350µs] or [-0.059%; +0.059%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20683118.719op/s; 20707526.448op/s] or [-0.059%; +0.059%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bc 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.020ms 6.037ms ± 0.007ms 6.036ms ± 0.004ms 6.040ms 6.046ms 6.071ms 6.090ms 0.89% 2.740 15.444 0.12% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.036ms; 6.038ms] or [-0.017%; +0.017%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bc 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.252µs 3.210µs ± 1.511µs 3.005µs ± 0.027µs 3.029µs 3.659µs 13.927µs 16.968µs 464.63% 7.592 59.205 46.95% 0.107µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.001µs; 3.419µs] or [-6.523%; +6.523%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bc 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.949µs 5.018µs ± 0.044µs 5.017µs ± 0.038µs 5.055µs 5.088µs 5.092µs 5.094µs 1.54% 0.412 -1.324 0.88% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.012µs; 5.024µs] or [-0.122%; +0.122%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bc 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.344µs 2.394µs ± 0.016µs 2.393µs ± 0.006µs 2.400µs 2.420µs 2.430µs 2.456µs 2.62% -0.334 2.493 0.68% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.392µs; 2.396µs] or [-0.095%; +0.095%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bc 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.378µs 25.599µs ± 11.313µs 17.585µs ± 0.105µs 35.367µs 41.962µs 54.853µs 96.745µs 450.16% 2.030 7.962 44.08% 0.800µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.031µs; 27.167µs] or [-6.125%; +6.125%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bc 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 56.816ms 57.047ms ± 0.129ms 57.032ms ± 0.062ms 57.091ms 57.300ms 57.450ms 57.799ms 1.34% 1.877 6.607 0.23% 0.009ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [57.029ms; 57.065ms] or [-0.031%; +0.031%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bc 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.764µs 33.582µs ± 1.046µs 32.987µs ± 0.155µs 34.776µs 35.467µs 35.556µs 36.824µs 11.63% 1.009 -0.686 3.11% 0.074µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.437µs; 33.727µs] or [-0.432%; +0.432%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bc 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.734µs 209.204µs ± 0.165µs 209.201µs ± 0.098µs 209.302µs 209.457µs 209.578µs 209.733µs 0.25% -0.035 0.380 0.08% 0.012µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4767971.312op/s 4780016.010op/s ± 3764.156op/s 4780083.622op/s ± 2241.120op/s 4782285.141op/s 4786150.571op/s 4788565.838op/s 4790791.460op/s 0.22% 0.041 0.378 0.08% 266.166op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.598µs 18.695µs ± 0.052µs 18.709µs ± 0.034µs 18.731µs 18.763µs 18.789µs 18.817µs 0.58% -0.463 -0.764 0.28% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53143003.318op/s 53491909.609op/s ± 149122.888op/s 53451191.723op/s ± 95894.318op/s 53602539.238op/s 53760635.010op/s 53767351.169op/s 53769320.502op/s 0.60% 0.472 -0.762 0.28% 10544.581op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.906µs 10.967µs ± 0.037µs 10.969µs ± 0.029µs 10.994µs 11.024µs 11.039µs 11.056µs 0.79% 0.050 -0.993 0.33% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 90447807.093op/s 91183655.846op/s ± 303438.424op/s 91165374.096op/s ± 239034.686op/s 91427285.473op/s 91631622.283op/s 91674912.389op/s 91694974.551op/s 0.58% -0.040 -1.000 0.33% 21456.337op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [209.182µs; 209.227µs] or [-0.011%; +0.011%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4779494.334op/s; 4780537.686op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.687µs; 18.702µs] or [-0.039%; +0.039%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53471242.611op/s; 53512576.607op/s] or [-0.039%; +0.039%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.962µs; 10.972µs] or [-0.046%; +0.046%] None None None
normalization/normalize_name/normalize_name/good throughput [91141602.199op/s; 91225709.493op/s] or [-0.046%; +0.046%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bc 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 66.208µs 66.432µs ± 0.217µs 66.408µs ± 0.042µs 66.451µs 66.549µs 67.118µs 69.050µs 3.98% 9.278 105.717 0.33% 0.015µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [66.402µs; 66.462µs] or [-0.045%; +0.045%] None None None

Baseline

Omitted due to size.

@hoolioh hoolioh force-pushed the julio/fix-integration-test branch from 58e9814 to 663b3bc Compare March 28, 2025 13:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants