Compare commits

Home / Compare f34ebdd5 .. 421bf458

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.016=-0.001
σ0.370-0.371=-0.000
min53.867-53.867=-0.000
max55.067-55.070=-0.002
mean417.000
σ0.000
min417.000
max417.000
mean0.139-0.141=-0.002
σ0.004-0.005=-0.001
min0.136-0.137=-0.001
max0.145-0.151=-0.006
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.000
σ0.007-0.006=0.002
min43.312-43.316=-0.004
max43.337-43.330=0.007
mean417.000
σ0.000
min417.000
max417.000
mean0.124-0.121=0.003
σ0.003-0.002=0.001
min0.121-0.119=0.002
max0.129-0.126=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.313=-0.003
σ1.184-1.162=0.022
min1005.762-1005.741=0.021
max1011.267-1011.177=0.090
mean1051.400-1056.500=-5.100
σ304.066-302.322=1.744
min587.000-598.000=-11.000
max1641.000-1452.000=189.000
mean1.574-1.502=0.072
σ0.103-0.076=0.026
min1.485-1.401=0.084
max1.782-1.700=0.082

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.434
σ0.178
min0.328
max0.750
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.912
σ0.185
min0.814
max1.241
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.536
σ0.058
min0.490
max0.636
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.839
σ0.035
min0.807
max0.898

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115
σ0.034
min964.085
max964.171
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.825
σ0.017
min0.807
max0.848
name=cdr_enhanced_4k_loc.art
mean884.711
σ0.007
min884.703
max884.722
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.736
σ0.002
min0.733
max0.738

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.721
mean1641.000
σ0.000
min1641.000
max1641.000
mean3.507
σ0.096
min3.359
max3.920
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1641.000
σ0.000
min1641.000
max1641.000
mean3.501
σ0.068
min3.347
max3.788
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.731
σ0.017
min0.699
max0.834
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1641.000
σ0.000
min1641.000
max1641.000
mean0.684
σ0.051
min0.490
max0.759

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.410-296.257=0.153
σ0.226-0.260=-0.034
min296.284-296.114=0.170
max297.032-296.977=0.056
mean1904.000-1959.000=-55.000
σ0.000
min1904.000-1959.000=-55.000
max1904.000-1959.000=-55.000
mean0.583-0.577=0.006
σ0.028-0.032=-0.004
min0.522-0.515=0.007
max0.631-0.601=0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.690-284.700=-0.010
σ0.036-0.035=0.001
min284.640-284.654=-0.014
max284.725-284.743=-0.018
mean1641.000-1452.000=189.000
σ0.000
min1641.000-1452.000=189.000
max1641.000-1452.000=189.000
mean0.397-0.401=-0.004
σ0.009-0.008=0.001
min0.386-0.386=-0.000
max0.404-0.405=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.086-1295.070=0.016
σ0.111-0.099=0.012
min1294.964-1294.958=0.007
max1295.220-1295.174=0.046
mean1641.000-1452.000=189.000
σ0.000
min1641.000-1452.000=189.000
max1641.000-1452.000=189.000
mean1.935-1.860=0.075
σ0.092-0.090=0.002
min1.829-1.784=0.045
max2.031-2.005=0.026
iters=5
new-facts=6402
prior-facts=1
mean1539.184-1539.197=-0.013
σ6.871-6.865=0.006
min1535.926-1535.870=0.056
max1551.471-1551.474=-0.002
mean1641.000-1452.000=189.000
σ0.000
min1641.000-1452.000=189.000
max1641.000-1452.000=189.000
mean2.259-2.246=0.013
σ0.235-0.263=-0.028
min2.045-2.039=0.007
max2.591-2.679=-0.088
iters=5
new-facts=6402
prior-facts=6402
mean1856.993-1856.976=0.017
σ0.054-0.071=-0.017
min1856.938-1856.892=0.045
max1857.069-1857.053=0.015
mean1772.200-1714.200=58.000
σ129.200-169.780=-40.580
min1641.000-1515.000=126.000
max1904.000-1959.000=-55.000
mean3.120-2.863=0.257
σ0.353-0.078=0.275
min2.876-2.805=0.071
max3.737-2.999=0.738

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.191-1.763=-0.572
σ0.280-0.187=0.093
min0.936-1.434=-0.498
max1.647-1.889=-0.242

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.792=-0.007
σ581.212-581.218=-0.007
min157.178
max1319.603-1319.620=-0.017
mean96.250
σ8.500
min92.000
max109.000
mean1641.000-1452.000=189.000
σ0.000
min1641.000-1452.000=189.000
max1641.000-1452.000=189.000
mean0.548-0.536=0.012
σ0.568-0.549=0.019
min0.262-0.255=0.007
max1.399-1.358=0.041
policies=20
mean1572.090-1572.113=-0.023
σ0.358-0.317=0.041
min1571.849-1571.931=-0.082
max1572.623-1572.588=0.035
mean920.000
σ0.000
min920.000
max920.000
mean1641.000-1452.000=189.000
σ0.000
min1641.000-1452.000=189.000
max1641.000-1452.000=189.000
mean2.640-2.620=0.020
σ0.014-0.015=-0.000
min2.625-2.605=0.020
max2.655-2.638=0.016
policies=200
mean15729.028-15728.995=0.033
σ0.166-0.141=0.025
min15728.840-15728.858=-0.018
max15729.238-15729.178=0.061
mean9200.000
σ0.000
min9200.000
max9200.000
mean1641.000-1452.000=189.000
σ0.000
min1641.000-1452.000=189.000
max1641.000-1452.000=189.000
mean26.541-26.483=0.058
σ0.048-0.145=-0.097
min26.493-26.353=0.140
max26.607-26.675=-0.068