Compare commits

Home / Compare ae49818d .. 81251896

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-53.705=-0.001
σ0.369-0.369=-0.001
min53.556-53.569=-0.013
max54.753-54.756=-0.003
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.137-0.138=-0.001
σ0.004-0.004=-0.000
min0.129-0.131=-0.002
max0.142-0.144=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.058-43.059=-0.000
σ0.004-0.006=-0.002
min43.053-43.053=-0.000
max43.065-43.072=-0.008
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.122-0.120=0.002
σ0.003-0.004=-0.000
min0.120-0.115=0.005
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.106-1005.107=-0.001
σ0.883-0.886=-0.002
min1004.637-1004.640=-0.003
max1008.769-1008.764=0.005
mean1056.750-1062.350=-5.600
σ319.911-327.632=-7.721
min557.000-553.000=4.000
max1631.000-1630.000=1.000
mean1.632-1.644=-0.011
σ0.078-0.092=-0.015
min1.546-1.544=0.002
max1.886-1.850=0.036

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean0.464-0.456=0.008
σ0.154-0.126=0.028
min0.358-0.373=-0.016
max0.732-0.677=0.055
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean0.927-0.902=0.025
σ0.186-0.078=0.108
min0.831-0.846=-0.014
max1.259-1.037=0.222
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean0.557-0.559=-0.002
σ0.055-0.052=0.002
min0.523-0.523=-0.000
max0.653-0.651=0.002
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean0.869-0.871=-0.002
σ0.030-0.037=-0.008
min0.845-0.839=0.006
max0.921-0.932=-0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.553=-0.000
σ0.024-0.031=-0.007
min963.523-963.535=-0.012
max963.582-963.609=-0.027
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean0.828-0.784=0.044
σ0.058-0.074=-0.016
min0.726-0.669=0.058
max0.865-0.856=0.008
name=cdr_enhanced_4k_loc.art
mean884.856-884.853=0.002
σ0.005-0.006=-0.000
min884.847
max884.861-884.860=0.001
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean0.727-0.741=-0.014
σ0.051-0.017=0.034
min0.636-0.727=-0.091
max0.752-0.770=-0.018

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.711-7.711=0.000
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean4.316-4.320=-0.004
σ0.128-0.089=0.038
min4.161-4.062=0.099
max5.261-4.584=0.677
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean4.297-4.300=-0.003
σ0.085-0.076=0.009
min4.130-4.170=-0.039
max4.610-4.581=0.029
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean0.766-0.766=0.000
σ0.028-0.023=0.005
min0.726-0.705=0.021
max0.944-0.870=0.073
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean0.729-0.717=0.012
σ0.024-0.020=0.004
min0.583-0.681=-0.098
max0.801-0.799=0.002

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.530-294.132=0.397
σ0.192-0.236=-0.044
min294.369-293.947=0.421
max295.061-294.760=0.301
mean1905.000-1917.000=-12.000
σ0.000
min1905.000-1917.000=-12.000
max1905.000-1917.000=-12.000
mean0.570-0.572=-0.002
σ0.036-0.036=-0.000
min0.495-0.515=-0.020
max0.639-0.625=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.497-281.497=0.000
σ0.036-0.035=0.001
min281.454-281.453=0.001
max281.542-281.533=0.009
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean0.394-0.397=-0.003
σ0.006-0.005=0.001
min0.386-0.390=-0.004
max0.400-0.405=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1291.472-1291.483=-0.011
σ0.096-0.110=-0.015
min1291.360-1291.357=0.003
max1291.569-1291.613=-0.043
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean1.866-1.987=-0.122
σ0.066-0.122=-0.056
min1.784-1.817=-0.033
max1.927-2.153=-0.226
iters=5
new-facts=6402
prior-facts=1
mean1534.332-1534.329=0.003
σ4.030-4.027=0.003
min1532.295-1532.284=0.011
max1541.532-1541.522=0.010
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean2.286-2.286=0.000
σ0.223-0.161=0.062
min2.024-2.028=-0.004
max2.490-2.445=0.045
iters=5
new-facts=6402
prior-facts=6402
mean1853.358-1853.351=0.007
σ0.054-0.056=-0.002
min1853.298-1853.309=-0.011
max1853.433-1853.437=-0.004
mean1771.600-1778.400=-6.800
σ129.197-137.145=-7.948
min1631.000-1630.000=1.000
max1905.000-1917.000=-12.000
mean3.116-3.098=0.018
σ0.359-0.359=-0.000
min2.868-2.881=-0.013
max3.742-3.735=0.007

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.360-1.471=-0.111
σ0.315-0.240=0.075
min1.113-1.265=-0.153
max1.911-1.854=0.057

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-442.428=0.002
σ577.064-577.065=-0.001
min153.896-153.894=0.003
max1308.025-1308.025=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean0.543-0.553=-0.009
σ0.572-0.585=-0.013
min0.257-0.258=-0.001
max1.402-1.431=-0.029
policies=20
mean1539.232-1539.215=0.017
σ0.349-0.335=0.014
min1539.001-1538.986=0.016
max1539.752-1539.713=0.038
mean920.000
σ0.000
min920.000
max920.000
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean2.629-2.598=0.032
σ0.058-0.013=0.045
min2.570-2.582=-0.012
max2.709-2.614=0.096
policies=200
mean15400.368-15400.469=-0.100
σ0.096-0.109=-0.013
min15400.231-15400.377=-0.145
max15400.455-15400.619=-0.164
mean9200.000
σ0.000
min9200.000
max9200.000
mean1631.000-1630.000=1.000
σ0.000
min1631.000-1630.000=1.000
max1631.000-1630.000=1.000
mean26.055-26.121=-0.066
σ0.057-0.036=0.021
min25.982-26.071=-0.089
max26.103-26.156=-0.053