Compare commits

Home / Compare 1de2e6d1 .. da63dbfc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.430-54.432=-0.002
σ0.050-0.050=0.000
min54.388-54.393=-0.005
max54.568-54.569=-0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.135-0.137=-0.002
σ0.005-0.003=0.002
min0.127-0.133=-0.006
max0.143-0.141=0.002
cache=y
dps=1
iters=10
policies=100
mean43.761-43.761=0.000
σ0.005-0.005=0.000
min43.751-43.748=0.002
max43.770-43.768=0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.118-0.116=0.001
σ0.005-0.004=0.002
min0.111-0.111=-0.000
max0.129-0.123=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1764.657-1764.659=-0.002
σ0.369-0.367=0.003
min1764.082-1764.085=-0.003
max1765.258-1765.256=0.002
mean1646.250-1642.350=3.900
σ629.301-645.814=-16.512
min626.000-630.000=-4.000
max2758.000-2731.000=27.000
mean2.494-2.528=-0.034
σ0.237-0.259=-0.022
min2.275-2.280=-0.005
max3.078-3.128=-0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean345.007-345.003=0.003
σ0.070-0.069=0.001
min344.883-344.880=0.002
max345.052-345.042=0.009
mean2758.000-2731.000=27.000
σ0.000
min2758.000-2731.000=27.000
max2758.000-2731.000=27.000
mean0.449-0.450=-0.001
σ0.006-0.019=-0.013
min0.444-0.435=0.009
max0.459-0.476=-0.018
iters=5
new-facts=1
prior-facts=6402
mean2007.179-2007.175=0.004
σ0.011-0.008=0.003
min2007.169-2007.168=0.002
max2007.196-2007.186=0.010
mean2758.000-2731.000=27.000
σ0.000
min2758.000-2731.000=27.000
max2758.000-2731.000=27.000
mean2.683-2.741=-0.058
σ0.096-0.101=-0.005
min2.530-2.631=-0.101
max2.782-2.899=-0.117
iters=5
new-facts=6402
prior-facts=1
mean4831.942-4832.125=-0.183
σ7.789-7.731=0.058
min4828.166-4828.505=-0.339
max4845.873-4845.952=-0.079
mean2758.000-2731.000=27.000
σ0.000
min2758.000-2731.000=27.000
max2758.000-2731.000=27.000
mean8.583-9.013=-0.430
σ0.573-0.761=-0.188
min7.915-7.789=0.126
max9.086-9.591=-0.505
iters=5
new-facts=6402
prior-facts=6402
mean5019.579-5019.593=-0.014
σ0.011-0.031=-0.020
min5019.567-5019.558=0.009
max5019.593-5019.644=-0.050
mean3028.400-3014.000=14.400
σ264.542-237.072=27.470
min2758.000-2731.000=27.000
max3400.000-3298.000=102.000
mean9.805-10.067=-0.262
σ0.127-0.542=-0.414
min9.662-9.483=0.179
max9.988-10.939=-0.951

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.096-0.979=0.117
σ0.251-0.140=0.111
min0.921-0.913=0.008
max1.530-1.228=0.302

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.520-466.527=-0.007
σ574.776-574.787=-0.011
min179.124-179.125=-0.001
max1328.685-1328.708=-0.023
mean90.250
σ8.500
min86.000
max103.000
mean2758.000-2731.000=27.000
σ0.000
min2758.000-2731.000=27.000
max2758.000-2731.000=27.000
mean0.439-0.476=-0.037
σ0.306-0.403=-0.097
min0.284-0.272=0.013
max0.899-1.081=-0.182
policies=20
mean1791.562-1791.547=0.015
σ0.373-0.380=-0.008
min1791.281-1791.289=-0.009
max1792.107-1792.112=-0.004
mean860.000
σ0.000
min860.000
max860.000
mean2758.000-2731.000=27.000
σ0.000
min2758.000-2731.000=27.000
max2758.000-2731.000=27.000
mean2.824-2.771=0.053
σ0.016-0.035=-0.019
min2.802-2.737=0.065
max2.840-2.819=0.021
policies=200
mean17922.949-17922.986=-0.037
σ0.523-0.506=0.016
min17922.509-17922.674=-0.165
max17923.707-17923.740=-0.033
mean8600.000
σ0.000
min8600.000
max8600.000
mean2758.000-2731.000=27.000
σ0.000
min2758.000-2731.000=27.000
max2758.000-2731.000=27.000
mean27.916-27.772=0.144
σ0.077-0.087=-0.010
min27.815-27.712=0.104
max28.001-27.901=0.101