Compare commits

Home / Compare 1d4af8e3 .. dc693041

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.965=-0.001
σ0.370-0.369=0.001
min53.818-53.824=-0.006
max55.016-55.015=0.002
mean418.000-416.800=1.200
σ0.000-0.422=-0.422
min418.000-416.000=2.000
max418.000-417.000=1.000
mean0.137-0.143=-0.006
σ0.005-0.010=-0.004
min0.130-0.136=-0.006
max0.147-0.167=-0.020
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.007-0.007=0.001
min43.311-43.314=-0.004
max43.339-43.337=0.002
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.121-0.118=0.003
σ0.004-0.004=-0.000
min0.114-0.113=0.000
max0.128-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.514-1006.515=-0.001
σ1.191-1.168=0.023
min1005.975-1005.950=0.025
max1011.498-1011.411=0.087
mean1047.850-1056.000=-8.150
σ314.926-315.655=-0.728
min551.000-568.000=-17.000
max1528.000-1617.000=-89.000
mean1.558-1.543=0.015
σ0.079-0.052=0.027
min1.480-1.487=-0.007
max1.757-1.652=0.105

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.003-0.002=0.000
min0.882
max0.887-0.887=0.000
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean0.442-0.436=0.006
σ0.116-0.185=-0.069
min0.336-0.337=-0.001
max0.630-0.766=-0.137
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean0.877-0.913=-0.036
σ0.090-0.166=-0.076
min0.816-0.819=-0.003
max1.034-1.209=-0.175
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean0.589-0.528=0.061
σ0.069-0.054=0.015
min0.513-0.495=0.019
max0.677-0.623=0.053
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean0.870-0.842=0.028
σ0.040-0.034=0.006
min0.840-0.818=0.023
max0.939-0.902=0.037

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.821-964.839=-0.018
σ0.024-0.029=-0.005
min964.802-964.817=-0.015
max964.860-964.887=-0.027
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean0.837-0.825=0.012
σ0.024-0.031=-0.006
min0.807-0.778=0.029
max0.858-0.854=0.004
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.002
σ0.006-0.008=-0.001
min885.504
max885.518-885.522=-0.004
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean0.710-0.727=-0.017
σ0.020-0.029=-0.008
min0.686-0.676=0.010
max0.738-0.743=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean2.781-4.224=-1.443
σ0.065-0.077=-0.013
min2.661-4.087=-1.427
max3.016-4.575=-1.559
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean2.898-4.241=-1.343
σ0.266-0.103=0.164
min2.668-3.759=-1.092
max3.647-4.526=-0.879
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean0.531-0.745=-0.214
σ0.025-0.018=0.006
min0.492-0.714=-0.223
max0.665-0.861=-0.197
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean0.510-0.707=-0.197
σ0.028-0.013=0.015
min0.480-0.678=-0.198
max0.736-0.765=-0.029

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.319-296.423=-0.105
σ0.276-0.204=0.072
min296.132-296.218=-0.086
max297.073-296.946=0.127
mean1907.000-2031.000=-124.000
σ0.000
min1907.000-2031.000=-124.000
max1907.000-2031.000=-124.000
mean0.559-0.565=-0.006
σ0.032-0.041=-0.009
min0.513-0.502=0.011
max0.596-0.600=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.040-285.026=0.013
σ0.027-0.031=-0.004
min285.014-284.983=0.031
max285.070-285.068=0.002
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean0.398-0.398=0.000
σ0.008-0.009=-0.001
min0.389-0.389=0.000
max0.410-0.408=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.420-1295.420=0.000
σ0.067-0.109=-0.042
min1295.339-1295.299=0.041
max1295.508-1295.555=-0.047
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean2.084-1.887=0.198
σ0.061-0.096=-0.034
min2.030-1.800=0.230
max2.170-2.032=0.138
iters=5
new-facts=6402
prior-facts=1
mean1539.551-1539.525=0.025
σ6.827-6.847=-0.020
min1536.339-1536.250=0.089
max1551.760-1551.771=-0.011
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean2.292-2.266=0.026
σ0.174-0.275=-0.101
min2.110-2.043=0.067
max2.505-2.695=-0.190
iters=5
new-facts=6402
prior-facts=6402
mean1857.312-1857.334=-0.022
σ0.081-0.055=0.026
min1857.190-1857.265=-0.075
max1857.399-1857.406=-0.007
mean1750.400-1768.000=-17.600
σ164.190-181.350=-17.161
min1528.000-1617.000=-89.000
max1907.000-2031.000=-124.000
mean3.126-2.817=0.309
σ0.280-0.109=0.172
min2.853-2.691=0.162
max3.556-2.955=0.601

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.726-1.176=0.550
σ0.142-0.312=-0.170
min1.564-0.938=0.627
max1.869-1.694=0.175

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-448.189=0.003
σ581.331-581.331=0.000
min157.524-157.521=0.004
max1320.188-1320.186=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean0.552-0.542=0.010
σ0.577-0.556=0.021
min0.260-0.262=-0.002
max1.417-1.376=0.041
policies=20
mean1575.571-1575.555=0.016
σ0.355-0.363=-0.007
min1575.330-1575.314=0.017
max1576.099-1576.095=0.004
mean920.000
σ0.000
min920.000
max920.000
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean2.630-2.641=-0.011
σ0.011-0.017=-0.007
min2.616-2.624=-0.009
max2.642-2.659=-0.018
policies=200
mean15763.710-15763.562=0.148
σ0.032-0.094=-0.063
min15763.677-15763.492=0.185
max15763.753-15763.701=0.052
mean9200.000
σ0.000
min9200.000
max9200.000
mean1528.000-1617.000=-89.000
σ0.000
min1528.000-1617.000=-89.000
max1528.000-1617.000=-89.000
mean26.583-26.601=-0.018
σ0.014-0.055=-0.041
min26.568-26.544=0.024
max26.595-26.675=-0.080