Compare commits

Home / Compare e0a68f55 .. 5b482f93

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958-30.958=-0.000
σ0.050-0.048=0.003
min30.915-30.921=-0.006
max31.096-31.091=0.006
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.075-0.078=-0.002
σ0.005-0.004=0.002
min0.070-0.074=-0.004
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=0.000
σ0.002-0.003=-0.001
min21.057-21.055=0.001
max21.063-21.064=-0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.059-0.063=-0.004
σ0.004-0.003=0.001
min0.057-0.061=-0.004
max0.070-0.070=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.411=-0.001
σ0.361-0.361=0.000
min1750.849-1750.841=0.007
max1751.994-1751.996=-0.003
mean1651.150-1636.100=15.050
σ615.506-600.743=14.763
min636.000-641.000=-5.000
max2487.000-2443.000=44.000
mean2.807-2.817=-0.010
σ0.199-0.171=0.028
min2.309-2.323=-0.014
max3.088-3.032=0.056

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.764-275.766=-0.002
σ0.012-0.009=0.003
min275.749-275.758=-0.010
max275.777-275.777=-0.000
mean2487.000-2443.000=44.000
σ0.000
min2487.000-2443.000=44.000
max2487.000-2443.000=44.000
mean0.400-0.407=-0.007
σ0.016-0.011=0.005
min0.375-0.397=-0.022
max0.419-0.420=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.296-2168.292=0.004
σ0.006-0.013=-0.007
min2168.292-2168.274=0.018
max2168.306-2168.307=-0.001
mean2487.000-2443.000=44.000
σ0.000
min2487.000-2443.000=44.000
max2487.000-2443.000=44.000
mean2.974-2.843=0.131
σ0.148-0.193=-0.045
min2.787-2.700=0.087
max3.165-3.182=-0.017
iters=5
new-facts=6402
prior-facts=1
mean5048.006-5048.159=-0.153
σ1.021-0.895=0.126
min5047.093-5047.657=-0.564
max5049.752-5049.754=-0.002
mean2487.000-2443.000=44.000
σ0.000
min2487.000-2443.000=44.000
max2487.000-2443.000=44.000
mean8.787-8.480=0.308
σ0.482-0.382=0.100
min8.122-8.062=0.060
max9.393-9.050=0.343
iters=5
new-facts=6402
prior-facts=6402
mean5179.251-5179.232=0.019
σ0.075-0.080=-0.005
min5179.184-5179.158=0.026
max5179.345-5179.320=0.025
mean3227.800-3195.400=32.400
σ395.165-505.378=-110.214
min2690.000-2580.000=110.000
max3733.000-3867.000=-134.000
mean10.046-9.814=0.232
σ0.170-0.205=-0.035
min9.797-9.552=0.244
max10.237-9.991=0.246

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.731-1.813=-0.082
σ0.170-0.071=0.100
min1.467-1.741=-0.274
max1.894-1.911=-0.017

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.332-463.330=0.001
σ572.196-572.198=-0.002
min177.230-177.230=-0.000
max1321.626-1321.627=-0.002
mean79.750
σ7.500
min76.000
max91.000
mean2487.000-2443.000=44.000
σ0.000
min2487.000-2443.000=44.000
max2487.000-2443.000=44.000
mean0.548-0.560=-0.012
σ0.526-0.548=-0.022
min0.277-0.284=-0.007
max1.337-1.381=-0.045
policies=20
mean1772.568-1772.566=0.001
σ0.343-0.335=0.008
min1772.334-1772.340=-0.006
max1773.076-1773.063=0.013
mean760.000
σ0.000
min760.000
max760.000
mean2487.000-2443.000=44.000
σ0.000
min2487.000-2443.000=44.000
max2487.000-2443.000=44.000
mean2.769-2.757=0.012
σ0.029-0.008=0.021
min2.732-2.747=-0.015
max2.803-2.766=0.037
policies=200
mean17732.247-17732.494=-0.247
σ0.705-0.532=0.174
min17731.691-17732.119=-0.428
max17733.279-17733.281=-0.002
mean7600.000
σ0.000
min7600.000
max7600.000
mean2487.000-2443.000=44.000
σ0.000
min2487.000-2443.000=44.000
max2487.000-2443.000=44.000
mean27.805-27.837=-0.031
σ0.146-0.181=-0.035
min27.701-27.683=0.019
max28.020-28.083=-0.063