Compare commits

Home / Compare 87bc5ef3 .. 915ad812

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.017-54.014=0.003
σ0.369-0.369=-0.001
min53.875-53.869=0.006
max55.066-55.065=0.001
mean415.900-414.000=1.900
σ0.316-0.000=0.316
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.147-0.138=0.009
σ0.008-0.005=0.002
min0.138-0.130=0.008
max0.159-0.144=0.015
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.006-0.007=-0.001
min43.315-43.310=0.005
max43.337-43.337=0.000
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.123-0.123=0.000
σ0.003-0.004=-0.001
min0.120-0.120=0.000
max0.129-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.306=0.004
σ1.175-1.185=-0.010
min1005.751-1005.772=-0.021
max1011.232-1011.272=-0.040
mean1047.400-1045.350=2.050
σ313.551-312.864=0.687
min597.000-596.000=1.000
max1645.000-1639.000=6.000
mean1.546-1.568=-0.022
σ0.068-0.092=-0.024
min1.481-1.489=-0.009
max1.723-1.821=-0.098

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean0.418-0.441=-0.023
σ0.137-0.129=0.008
min0.348-0.345=0.002
max0.663-0.667=-0.004
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean0.902-0.884=0.019
σ0.103-0.108=-0.005
min0.824-0.823=0.001
max1.081-1.076=0.005
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean0.555-0.543=0.012
σ0.054-0.045=0.009
min0.503-0.508=-0.005
max0.642-0.621=0.021
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean0.860-0.841=0.019
σ0.034-0.041=-0.007
min0.833-0.815=0.019
max0.918-0.913=0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=0.000
σ0.034-0.032=0.002
min964.087-964.088=-0.001
max964.171-964.168=0.003
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean0.788-0.792=-0.005
σ0.055-0.071=-0.016
min0.736-0.676=0.061
max0.865-0.869=-0.004
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=-0.001
σ0.006-0.007=-0.001
min884.703-884.705=-0.001
max884.717-884.722=-0.005
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean0.726-0.693=0.033
σ0.022-0.076=-0.055
min0.690-0.577=0.113
max0.746-0.756=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.718
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean4.207-4.233=-0.026
σ0.067-0.086=-0.019
min4.100-4.107=-0.007
max4.486-4.563=-0.077
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.668-7.666=0.002
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean4.204-4.234=-0.030
σ0.118-0.096=0.022
min4.084-4.083=0.001
max5.138-4.784=0.354
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean0.741-0.735=0.006
σ0.019-0.020=-0.001
min0.706-0.697=0.009
max0.862-0.869=-0.007
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean0.697-0.697=0.000
σ0.013-0.016=-0.002
min0.674-0.671=0.003
max0.771-0.771=-0.000

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.263-296.434=-0.171
σ0.227-0.241=-0.014
min296.076-296.238=-0.162
max296.870-297.086=-0.216
mean1918.000-1909.000=9.000
σ0.000
min1918.000-1909.000=9.000
max1918.000-1909.000=9.000
mean0.588-0.583=0.005
σ0.013-0.025=-0.012
min0.564-0.541=0.023
max0.598-0.632=-0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.697=-0.003
σ0.039-0.038=0.000
min284.639-284.642=-0.003
max284.735-284.739=-0.005
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean0.397-0.399=-0.002
σ0.011-0.010=0.002
min0.385-0.387=-0.002
max0.407-0.408=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.076-1295.072=0.004
σ0.109-0.101=0.008
min1294.959-1294.949=0.010
max1295.208-1295.187=0.022
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean1.902-2.009=-0.107
σ0.095-0.101=-0.006
min1.802-1.903=-0.101
max2.020-2.124=-0.104
iters=5
new-facts=6402
prior-facts=1
mean1539.192-1539.197=-0.006
σ6.852-6.862=-0.011
min1535.926-1535.912=0.014
max1551.445-1551.469=-0.024
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean2.275-2.286=-0.011
σ0.272-0.255=0.017
min2.056-2.044=0.011
max2.696-2.653=0.043
iters=5
new-facts=6402
prior-facts=6402
mean1856.986-1856.995=-0.008
σ0.060-0.055=0.005
min1856.926-1856.934=-0.008
max1857.071-1857.065=0.006
mean1777.000-1771.200=5.800
σ136.261-135.145=1.116
min1645.000-1639.000=6.000
max1918.000-1909.000=9.000
mean3.030-3.059=-0.029
σ0.189-0.285=-0.096
min2.855-2.870=-0.015
max3.347-3.565=-0.218

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.225-1.240=-0.016
σ0.256-0.280=-0.024
min0.955-0.949=0.007
max1.521-1.688=-0.167

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.785=0.000
σ581.213-581.213=-0.000
min157.176-157.176=0.000
max1319.605-1319.604=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean0.542-0.523=0.019
σ0.564-0.530=0.033
min0.257-0.257=0.000
max1.388-1.319=0.069
policies=20
mean1572.103-1572.102=0.001
σ0.358-0.352=0.006
min1571.860-1571.863=-0.002
max1572.636-1572.625=0.011
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean2.629-2.623=0.005
σ0.013-0.014=-0.001
min2.613-2.609=0.003
max2.643-2.642=0.001
policies=200
mean15728.985-15728.987=-0.001
σ0.168-0.147=0.022
min15728.891-15728.867=0.024
max15729.237-15729.186=0.051
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1639.000=6.000
σ0.000
min1645.000-1639.000=6.000
max1645.000-1639.000=6.000
mean26.604-26.493=0.112
σ0.097-0.044=0.053
min26.539-26.453=0.086
max26.747-26.540=0.207