Compare commits

Home / Compare 7603d5b8 .. b3d37be2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=-0.000
σ0.368-0.370=-0.001
min53.916-53.908=0.007
max55.103-55.106=-0.004
mean416.000-421.000=-5.000
σ0.000
min416.000-421.000=-5.000
max416.000-421.000=-5.000
mean0.139-0.138=0.001
σ0.004-0.006=-0.001
min0.135-0.130=0.005
max0.147-0.147=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.393-43.395=-0.002
σ0.007-0.005=0.001
min43.385-43.388=-0.003
max43.406-43.402=0.004
mean416.000-421.000=-5.000
σ0.000
min416.000-421.000=-5.000
max416.000-421.000=-5.000
mean0.122-0.123=-0.001
σ0.003-0.004=-0.000
min0.119-0.119=-0.000
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.984-1006.986=-0.003
σ0.855-0.852=0.003
min1006.483-1006.478=0.005
max1010.507-1010.490=0.017
mean1047.200-1050.900=-3.700
σ314.016-314.232=-0.216
min577.000-581.000=-4.000
max1645.000-1649.000=-4.000
mean1.534-1.543=-0.009
σ0.082-0.093=-0.011
min1.404-1.466=-0.062
max1.798-1.832=-0.034

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.001
σ0.002-0.002=0.000
min0.882
max0.887
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.430-0.422=0.008
σ0.144-0.116=0.027
min0.326-0.350=-0.024
max0.684-0.629=0.055
name=error_case.art
mean2.340-2.339=0.001
σ0.003-0.003=0.000
min2.337
max2.343-2.342=0.001
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.887-0.889=-0.002
σ0.091-0.078=0.013
min0.812-0.835=-0.024
max1.046-1.024=0.022
name=heavy_item.art
mean1.524-1.523=0.001
σ0.001-0.001=-0.000
min1.522
max1.525
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.545-0.534=0.011
σ0.054-0.048=0.006
min0.496-0.494=0.002
max0.632-0.609=0.023
name=nested_use.art
mean2.362
σ0.002
min2.360
max2.364
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.865-0.844=0.021
σ0.033-0.038=-0.005
min0.843-0.811=0.033
max0.924-0.908=0.015

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.832-964.831=0.001
σ0.028-0.025=0.003
min964.810-964.802=0.008
max964.876-964.861=0.014
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.808-0.814=-0.005
σ0.048-0.017=0.031
min0.748-0.784=-0.036
max0.864-0.828=0.036
name=cdr_enhanced_4k_loc.art
mean885.514-885.514=-0.000
σ0.007-0.004=0.002
min885.504-885.508=-0.004
max885.520-885.518=0.002
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.686-0.706=-0.020
σ0.057-0.028=0.029
min0.608-0.674=-0.066
max0.758-0.745=0.013

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean4.233-4.249=-0.016
σ0.099-0.089=0.009
min4.098-4.092=0.006
max4.633-4.564=0.069
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean4.236-4.232=0.005
σ0.077-0.081=-0.003
min4.113-4.074=0.039
max4.536-4.507=0.028
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.747-0.749=-0.001
σ0.019-0.019=-0.000
min0.685-0.716=-0.031
max0.851-0.860=-0.009
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.706-0.701=0.005
σ0.016-0.016=0.000
min0.635-0.673=-0.038
max0.764-0.777=-0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.627-295.463=0.164
σ0.258-0.230=0.028
min295.377-295.254=0.123
max296.311-296.025=0.286
mean1913.000-1929.000=-16.000
σ0.000
min1913.000-1929.000=-16.000
max1913.000-1929.000=-16.000
mean0.575-0.579=-0.004
σ0.053-0.058=-0.005
min0.513-0.473=0.040
max0.694-0.687=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.406-285.412=-0.007
σ0.032-0.036=-0.004
min285.365-285.366=-0.002
max285.441-285.456=-0.016
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.391-0.399=-0.008
σ0.009-0.008=0.001
min0.381-0.391=-0.010
max0.401-0.410=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1295.795-1295.794=0.001
σ0.114-0.112=0.002
min1295.666-1295.669=-0.003
max1295.947-1295.925=0.022
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean1.978-1.886=0.092
σ0.124-0.074=0.050
min1.843-1.823=0.020
max2.132-1.984=0.148
iters=5
new-facts=6402
prior-facts=1
mean1539.936-1539.997=-0.060
σ6.890-6.876=0.014
min1536.634-1536.723=-0.089
max1552.255-1552.291=-0.036
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean2.345-2.450=-0.104
σ0.207-0.298=-0.091
min2.102-2.149=-0.047
max2.618-2.827=-0.209
iters=5
new-facts=6402
prior-facts=6402
mean1857.705-1857.702=0.003
σ0.059-0.058=0.002
min1857.642-1857.632=0.010
max1857.785-1857.772=0.013
mean1772.800-1782.800=-10.000
σ134.715-140.685=-5.969
min1645.000-1649.000=-4.000
max1913.000-1929.000=-16.000
mean2.971-3.038=-0.068
σ0.212-0.143=0.070
min2.677-2.864=-0.187
max3.277-3.190=0.087

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.344-1.385=-0.041
σ0.221-0.277=-0.056
min1.107-1.112=-0.005
max1.702-1.844=-0.142

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.741=-0.000
σ580.934-580.934=0.000
min155.272-155.273=-0.000
max1317.142-1317.143=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean0.534-0.525=0.009
σ0.549-0.539=0.010
min0.255-0.255=0.000
max1.358-1.334=0.024
policies=20
mean1552.990-1552.993=-0.003
σ0.328-0.330=-0.002
min1552.767-1552.768=-0.001
max1553.478-1553.484=-0.006
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean2.590-2.594=-0.005
σ0.024-0.016=0.007
min2.569-2.581=-0.012
max2.620-2.616=0.004
policies=200
mean15537.931-15538.054=-0.123
σ0.082-0.091=-0.009
min15537.839-15537.951=-0.111
max15538.012-15538.150=-0.139
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1649.000=-4.000
σ0.000
min1645.000-1649.000=-4.000
max1645.000-1649.000=-4.000
mean26.122-26.165=-0.042
σ0.106-0.121=-0.015
min26.029-26.052=-0.023
max26.272-26.336=-0.063