Compare commits

Home / Compare 7a8db857 .. 1cb6f8b5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.965=-0.001
σ0.370-0.370=-0.000
min53.813-53.822=-0.009
max55.018-55.019=-0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.137-0.140=-0.003
σ0.007-0.004=0.003
min0.131-0.136=-0.005
max0.149-0.146=0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.005-0.007=-0.002
min43.314-43.311=0.003
max43.329-43.338=-0.009
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.121-0.123=-0.002
σ0.004-0.005=-0.001
min0.116-0.118=-0.002
max0.128-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.514-1006.512=0.001
σ1.180-1.183=-0.003
min1005.960-1005.968=-0.008
max1011.450-1011.463=-0.012
mean1057.800-1038.100=19.700
σ316.482-311.425=5.057
min548.000-547.000=1.000
max1510.000-1507.000=3.000
mean1.545-1.548=-0.003
σ0.082-0.076=0.006
min1.455-1.462=-0.007
max1.749-1.733=0.016

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.003-0.002=0.000
min0.882
max0.887-0.887=0.000
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean0.442-0.429=0.014
σ0.127-0.177=-0.050
min0.351-0.332=0.019
max0.652-0.744=-0.092
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean0.902-0.915=-0.013
σ0.104-0.172=-0.068
min0.838-0.825=0.013
max1.086-1.222=-0.136
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean0.543-0.528=0.014
σ0.051-0.050=0.001
min0.481-0.491=-0.009
max0.615-0.614=0.001
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.001=0.000
min2.360-2.360=-0.000
max2.364
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean0.881-0.843=0.038
σ0.051-0.034=0.017
min0.822-0.819=0.003
max0.923-0.900=0.023

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.827=0.003
σ0.029-0.034=-0.005
min964.806-964.802=0.004
max964.880-964.887=-0.007
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean0.833-0.816=0.017
σ0.056-0.019=0.037
min0.734-0.799=-0.065
max0.866-0.848=0.018
name=cdr_enhanced_4k_loc.art
mean885.511-885.510=0.001
σ0.008-0.004=0.004
min885.504
max885.523-885.516=0.007
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean0.682-0.673=0.010
σ0.045-0.064=-0.019
min0.635-0.608=0.027
max0.745-0.742=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.723=-0.002
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean3.474-4.203=-0.729
σ0.090-0.082=0.007
min3.331-4.051=-0.721
max3.914-4.507=-0.594
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean4.112-4.209=-0.096
σ0.343-0.073=0.270
min3.366-4.072=-0.706
max4.468-4.498=-0.029
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean0.756-0.735=0.022
σ0.033-0.020=0.013
min0.710-0.699=0.012
max0.871-0.855=0.016
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean0.717-0.704=0.012
σ0.035-0.016=0.019
min0.654-0.674=-0.019
max0.803-0.790=0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.592-296.390=0.202
σ0.227-0.222=0.004
min296.431-296.257=0.174
max297.182-296.999=0.183
mean1914.000-2025.000=-111.000
σ0.000
min1914.000-2025.000=-111.000
max1914.000-2025.000=-111.000
mean0.575-0.590=-0.015
σ0.064-0.015=0.049
min0.496-0.556=-0.060
max0.707-0.604=0.103

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.023-285.033=-0.010
σ0.040-0.036=0.004
min284.972-284.987=-0.015
max285.072-285.069=0.003
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean0.404-0.394=0.009
σ0.013-0.005=0.008
min0.387-0.388=-0.000
max0.423-0.399=0.024
iters=5
new-facts=1
prior-facts=6402
mean1295.413-1295.413=0.000
σ0.115-0.108=0.007
min1295.290-1295.285=0.005
max1295.554-1295.532=0.022
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean1.931-1.901=0.030
σ0.119-0.119=0.000
min1.790-1.805=-0.015
max2.059-2.089=-0.030
iters=5
new-facts=6402
prior-facts=1
mean1539.523-1539.515=0.007
σ6.861-6.836=0.025
min1536.225-1536.228=-0.004
max1551.792-1551.739=0.052
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean2.280-2.250=0.030
σ0.207-0.206=0.001
min2.044-2.025=0.019
max2.490-2.449=0.041
iters=5
new-facts=6402
prior-facts=6402
mean1857.313-1857.315=-0.002
σ0.064-0.060=0.004
min1857.235-1857.255=-0.019
max1857.405-1857.396=0.009
mean1751.200-1731.600=19.600
σ173.022-214.260=-41.238
min1510.000-1507.000=3.000
max1914.000-2025.000=-111.000
mean2.997-2.878=0.119
σ0.327-0.052=0.275
min2.586-2.821=-0.235
max3.499-2.942=0.557

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.509-1.630=-0.120
σ0.229-0.302=-0.073
min1.212-1.203=0.009
max1.801-1.858=-0.058

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.189-448.191=-0.003
σ581.332-581.331=0.001
min157.520-157.524=-0.004
max1320.187-1320.188=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean0.528-0.551=-0.023
σ0.531-0.580=-0.050
min0.261-0.259=0.002
max1.324-1.422=-0.098
policies=20
mean1575.555-1575.570=-0.015
σ0.355-0.348=0.007
min1575.318-1575.334=-0.016
max1576.083-1576.087=-0.003
mean920.000
σ0.000
min920.000
max920.000
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean2.628-2.621=0.007
σ0.013-0.014=-0.001
min2.616-2.601=0.015
max2.646-2.634=0.011
policies=200
mean15763.733-15763.777=-0.044
σ0.132-0.082=0.051
min15763.580-15763.705=-0.125
max15763.903-15763.893=0.010
mean9200.000
σ0.000
min9200.000
max9200.000
mean1510.000-1507.000=3.000
σ0.000
min1510.000-1507.000=3.000
max1510.000-1507.000=3.000
mean26.588-26.518=0.070
σ0.092-0.068=0.025
min26.498-26.458=0.040
max26.699-26.602=0.097