Compare commits

Home / Compare 78eb7731 .. d5a3b75f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.772-30.773=-0.001
σ0.045-0.045=0.000
min30.749-30.751=-0.002
max30.899-30.901=-0.001
mean413.200-413.000=0.200
σ0.422-0.000=0.422
min413.000
max414.000-413.000=1.000
mean0.075-0.079=-0.004
σ0.005-0.004=0.001
min0.070-0.076=-0.006
max0.086-0.085=0.001
cache=y
dps=1
iters=10
policies=100
mean21.059-21.059=-0.000
σ0.002-0.002=-0.000
min21.056-21.056=-0.001
max21.062-21.064=-0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.063-0.063=0.000
σ0.002-0.003=-0.000
min0.061-0.059=0.002
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.237-1751.236=0.001
σ0.364-0.362=0.002
min1750.669-1750.676=-0.007
max1751.828-1751.825=0.003
mean1666.950-1667.100=-0.150
σ640.248-630.176=10.072
min680.000-679.000=1.000
max2697.000-2640.000=57.000
mean2.913-2.837=0.076
σ0.071-0.106=-0.036
min2.793-2.621=0.172
max3.039-2.970=0.070

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.569-275.567=0.002
σ0.006-0.007=-0.001
min275.562-275.562=0.001
max275.577-275.578=-0.001
mean2697.000-2640.000=57.000
σ0.000
min2697.000-2640.000=57.000
max2697.000-2640.000=57.000
mean0.395-0.391=0.004
σ0.008-0.008=-0.000
min0.388-0.383=0.005
max0.404-0.400=0.004
iters=5
new-facts=1
prior-facts=6402
mean2168.093-2168.099=-0.007
σ0.013-0.009=0.004
min2168.070-2168.089=-0.019
max2168.103-2168.110=-0.007
mean2697.000-2640.000=57.000
σ0.000
min2697.000-2640.000=57.000
max2697.000-2640.000=57.000
mean2.924-2.997=-0.073
σ0.110-0.161=-0.051
min2.753-2.836=-0.082
max3.039-3.223=-0.184
iters=5
new-facts=6402
prior-facts=1
mean5047.793-5047.922=-0.129
σ1.013-0.896=0.116
min5046.754-5047.391=-0.636
max5049.484-5049.516=-0.032
mean2697.000-2640.000=57.000
σ0.000
min2697.000-2640.000=57.000
max2697.000-2640.000=57.000
mean8.769-9.018=-0.249
σ0.479-0.328=0.151
min8.090-8.597=-0.508
max9.406-9.493=-0.087
iters=5
new-facts=6402
prior-facts=6402
mean5178.980-5179.041=-0.062
σ0.192-0.082=0.110
min5178.670-5178.961=-0.291
max5179.145-5179.131=0.015
mean3218.200-3218.800=-0.600
σ381.829-388.112=-6.283
min2697.000-2684.000=13.000
max3699.000-3704.000=-5.000
mean9.922-9.864=0.057
σ0.278-0.271=0.007
min9.431-9.489=-0.058
max10.114-10.214=-0.100

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.069-1.295=-0.226
σ0.136-0.381=-0.245
min0.926-0.950=-0.023
max1.262-1.871=-0.609

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.208-463.203=0.005
σ572.659-572.661=-0.002
min176.868-176.872=-0.004
max1322.197-1322.194=0.002
mean77.500
σ7.000
min74.000
max88.000
mean2697.000-2640.000=57.000
σ0.000
min2697.000-2640.000=57.000
max2697.000-2640.000=57.000
mean0.539-0.550=-0.011
σ0.525-0.541=-0.016
min0.274-0.275=-0.001
max1.327-1.362=-0.035
policies=20
mean1768.974-1768.970=0.003
σ0.338-0.334=0.003
min1768.753-1768.757=-0.004
max1769.477-1769.469=0.008
mean740.000
σ0.000
min740.000
max740.000
mean2697.000-2640.000=57.000
σ0.000
min2697.000-2640.000=57.000
max2697.000-2640.000=57.000
mean2.764-2.744=0.020
σ0.031-0.019=0.011
min2.736-2.718=0.019
max2.800-2.764=0.036
policies=200
mean17696.103-17696.103=0.000
σ0.558-0.589=-0.031
min17695.799-17695.750=0.049
max17696.939-17696.981=-0.042
mean7400.000
σ0.000
min7400.000
max7400.000
mean2697.000-2640.000=57.000
σ0.000
min2697.000-2640.000=57.000
max2697.000-2640.000=57.000
mean27.674-27.657=0.016
σ0.087-0.132=-0.045
min27.592-27.467=0.125
max27.783-27.772=0.011