Compare commits

Home / Compare 600757fe .. 0c888ec9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.730=0.001
σ0.048-0.049=-0.001
min70.699-70.699=0.001
max70.866-70.868=-0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.160-0.157=0.003
σ0.004-0.005=-0.001
min0.152-0.151=0.000
max0.165-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=-0.000
σ0.004-0.002=0.001
min21.440-21.443=-0.002
max21.451-21.449=0.002
mean414.800-415.000=-0.200
σ0.422-0.000=0.422
min414.000-415.000=-1.000
max415.000
mean0.066-0.066=-0.000
σ0.003-0.002=0.000
min0.064-0.064=-0.000
max0.073-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.525-1754.528=-0.003
σ0.360-0.363=-0.003
min1753.954-1753.956=-0.002
max1755.109-1755.109=-0.001
mean1656.350-1642.100=14.250
σ639.805-630.677=9.128
min624.000-641.000=-17.000
max2838.000-2846.000=-8.000
mean2.816-2.812=0.004
σ0.201-0.191=0.009
min2.171-2.356=-0.186
max3.066-3.156=-0.090

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.610-273.609=0.001
σ0.005-0.007=-0.002
min273.603-273.602=0.001
max273.616-273.616=-0.000
mean2838.000-2846.000=-8.000
σ0.000
min2838.000-2846.000=-8.000
max2838.000-2846.000=-8.000
mean0.391-0.384=0.007
σ0.010-0.005=0.005
min0.379-0.381=-0.003
max0.401-0.392=0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.989-1934.009=-0.020
σ0.012-0.007=0.005
min1933.973-1933.998=-0.025
max1934.007-1934.016=-0.008
mean2838.000-2846.000=-8.000
σ0.000
min2838.000-2846.000=-8.000
max2838.000-2846.000=-8.000
mean3.018-3.119=-0.101
σ0.065-0.293=-0.229
min2.951-2.949=0.003
max3.123-3.640=-0.517
iters=5
new-facts=6402
prior-facts=1
mean4754.641-4754.699=-0.058
σ0.938-0.620=0.317
min4753.872-4754.283=-0.411
max4756.272-4755.795=0.477
mean2838.000-2846.000=-8.000
σ0.000
min2838.000-2846.000=-8.000
max2838.000-2846.000=-8.000
mean8.436-8.336=0.100
σ0.450-0.592=-0.142
min7.751-7.656=0.094
max8.998-9.008=-0.010
iters=5
new-facts=6402
prior-facts=6402
mean4945.149-4945.151=-0.002
σ0.168-0.173=-0.005
min4944.852-4944.843=0.009
max4945.251-4945.255=-0.003
mean3005.800-3042.000=-36.200
σ187.062-200.938=-13.876
min2838.000-2846.000=-8.000
max3293.000-3322.000=-29.000
mean8.593-8.623=-0.030
σ0.099-0.135=-0.036
min8.469-8.418=0.051
max8.738-8.787=-0.049

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.994-1.221=-0.226
σ0.139-0.226=-0.086
min0.930-0.922=0.008
max1.244-1.487=-0.243

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.849-472.835=0.014
σ574.937-574.932=0.005
min185.374-185.361=0.013
max1335.256-1335.233=0.022
mean88.250
σ8.500
min84.000
max101.000
mean2838.000-2846.000=-8.000
σ0.000
min2838.000-2846.000=-8.000
max2838.000-2846.000=-8.000
mean0.451-0.492=-0.041
σ0.305-0.376=-0.071
min0.293-0.296=-0.003
max0.908-1.056=-0.149
policies=20
mean1854.013-1854.008=0.005
σ0.363-0.373=-0.010
min1853.746-1853.732=0.013
max1854.541-1854.550=-0.009
mean840.000
σ0.000
min840.000
max840.000
mean2838.000-2846.000=-8.000
σ0.000
min2838.000-2846.000=-8.000
max2838.000-2846.000=-8.000
mean2.950-2.946=0.004
σ0.004-0.008=-0.003
min2.946-2.942=0.004
max2.956-2.958=-0.002
policies=200
mean18546.587-18546.723=-0.136
σ0.438-0.405=0.033
min18546.282-18546.362=-0.080
max18547.235-18547.298=-0.062
mean8400.000
σ0.000
min8400.000
max8400.000
mean2838.000-2846.000=-8.000
σ0.000
min2838.000-2846.000=-8.000
max2838.000-2846.000=-8.000
mean29.124-29.182=-0.058
σ0.473-0.548=-0.075
min28.847-28.789=0.058
max29.832-29.991=-0.158