Compare commits

Home / Compare efc50168 .. 6b8c7f9b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.390=-0.001
σ0.049-0.048=0.001
min70.361-70.363=-0.002
max70.525-70.522=0.003
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.156-0.152=0.004
σ0.004-0.004=-0.001
min0.149-0.148=0.002
max0.161-0.160=0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.003-0.003=-0.000
min21.140-21.140=0.000
max21.150-21.150=-0.000
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.064-0.063=0.001
σ0.003-0.003=-0.001
min0.057-0.058=-0.001
max0.068-0.067=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.396-1752.393=0.004
σ0.360-0.358=0.002
min1751.824-1751.827=-0.002
max1752.980-1752.977=0.002
mean1638.200-1654.850=-16.650
σ616.849-616.332=0.516
min622.000-636.000=-14.000
max2474.000-2491.000=-17.000
mean2.837-2.793=0.045
σ0.196-0.156=0.041
min2.216-2.426=-0.210
max3.052-2.969=0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.239-270.236=0.002
σ0.004-0.003=0.001
min270.232-270.233=-0.001
max270.242-270.241=0.001
mean2474.000-2491.000=-17.000
σ0.000
min2474.000-2491.000=-17.000
max2474.000-2491.000=-17.000
mean0.382-0.380=0.001
σ0.008-0.002=0.007
min0.377-0.378=-0.002
max0.396-0.383=0.014
iters=5
new-facts=1
prior-facts=6402
mean1930.698-1930.699=-0.001
σ0.014-0.012=0.002
min1930.682-1930.683=-0.002
max1930.715-1930.715=0.000
mean2474.000-2491.000=-17.000
σ0.000
min2474.000-2491.000=-17.000
max2474.000-2491.000=-17.000
mean2.525-2.484=0.040
σ0.108-0.106=0.002
min2.373-2.322=0.051
max2.638-2.586=0.052
iters=5
new-facts=6402
prior-facts=1
mean4751.184-4751.300=-0.116
σ1.100-1.035=0.065
min4750.336-4750.501=-0.165
max4753.066-4753.108=-0.042
mean2474.000-2491.000=-17.000
σ0.000
min2474.000-2491.000=-17.000
max2474.000-2491.000=-17.000
mean8.499-8.574=-0.075
σ0.589-0.601=-0.013
min7.622-7.911=-0.289
max9.145-9.243=-0.098
iters=5
new-facts=6402
prior-facts=6402
mean4941.869-4941.725=0.144
σ0.016-0.301=-0.284
min4941.852-4941.188=0.664
max4941.887-4941.880=0.007
mean3011.000-2968.200=42.800
σ313.172-422.854=-109.683
min2596.000-2491.000=105.000
max3414.000-3540.000=-126.000
mean8.549-8.464=0.085
σ0.138-0.115=0.022
min8.421-8.331=0.090
max8.719-8.643=0.077

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.769-1.763=0.006
σ0.125-0.194=-0.069
min1.601-1.465=0.136
max1.912-1.916=-0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.364-466.363=0.002
σ575.915-575.917=-0.002
min178.404-178.403=0.001
max1330.237-1330.237=-0.001
mean84.000
σ8.000
min80.000
max96.000
mean2474.000-2491.000=-17.000
σ0.000
min2474.000-2491.000=-17.000
max2474.000-2491.000=-17.000
mean0.562-0.538=0.024
σ0.558-0.515=0.044
min0.277-0.281=-0.004
max1.400-1.311=0.089
policies=20
mean1784.318-1784.299=0.019
σ0.350-0.349=0.000
min1784.097-1784.076=0.021
max1784.839-1784.819=0.020
mean800.000
σ0.000
min800.000
max800.000
mean2474.000-2491.000=-17.000
σ0.000
min2474.000-2491.000=-17.000
max2474.000-2491.000=-17.000
mean2.777-2.787=-0.011
σ0.010-0.008=0.001
min2.767-2.777=-0.010
max2.788-2.796=-0.008
policies=200
mean17849.903-17849.760=0.144
σ0.443-0.376=0.067
min17849.634-17849.489=0.145
max17850.566-17850.315=0.251
mean8000.000
σ0.000
min8000.000
max8000.000
mean2474.000-2491.000=-17.000
σ0.000
min2474.000-2491.000=-17.000
max2474.000-2491.000=-17.000
mean27.894-27.952=-0.058
σ0.057-0.031=0.025
min27.832-27.914=-0.083
max27.966-27.981=-0.015