Compare commits

Home / Compare 75e9972b .. 25476d13

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.793-35.798=-0.004
σ0.106-0.106=-0.000
min35.747-35.754=-0.007
max36.093-36.099=-0.005
mean412.900-410.000=2.900
σ0.316-0.000=0.316
min412.000-410.000=2.000
max413.000-410.000=3.000
mean0.076-0.073=0.003
σ0.003-0.003=-0.000
min0.074-0.069=0.005
max0.081-0.077=0.004
cache=y
dps=1
iters=10
policies=100
mean26.065-26.066=-0.000
σ0.003-0.003=0.000
min26.061-26.062=-0.000
max26.073-26.071=0.002
mean413.000-410.600=2.400
σ0.000-0.516=-0.516
min413.000-410.000=3.000
max413.000-411.000=2.000
mean0.061-0.061=0.000
σ0.003-0.003=-0.000
min0.059-0.059=-0.000
max0.068-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.238-1751.236=0.002
σ0.362-0.361=0.001
min1750.677-1750.670=0.007
max1751.825-1751.803=0.023
mean1634.350-1651.550=-17.200
σ616.533-643.493=-26.960
min628.000-624.000=4.000
max2471.000-2844.000=-373.000
mean2.853-2.810=0.043
σ0.118-0.147=-0.029
min2.541-2.462=0.079
max3.083-3.012=0.071

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.566-275.568=-0.002
σ0.007-0.007=-0.000
min275.559-275.557=0.001
max275.575-275.575=-0.000
mean2471.000-2844.000=-373.000
σ0.000
min2471.000-2844.000=-373.000
max2471.000-2844.000=-373.000
mean0.395-0.404=-0.009
σ0.009-0.007=0.002
min0.388-0.397=-0.008
max0.406-0.411=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2168.104-2168.101=0.003
σ0.003-0.010=-0.007
min2168.099-2168.089=0.010
max2168.107-2168.113=-0.006
mean2471.000-2844.000=-373.000
σ0.000
min2471.000-2844.000=-373.000
max2471.000-2844.000=-373.000
mean2.959-3.050=-0.091
σ0.151-0.172=-0.021
min2.769-2.811=-0.041
max3.153-3.223=-0.070
iters=5
new-facts=6402
prior-facts=1
mean5047.926-5047.888=0.038
σ0.884-0.878=0.006
min5047.390-5047.414=-0.023
max5049.500-5049.450=0.049
mean2471.000-2844.000=-373.000
σ0.000
min2471.000-2844.000=-373.000
max2471.000-2844.000=-373.000
mean8.781-8.830=-0.049
σ0.573-0.374=0.198
min8.069-8.214=-0.145
max9.389-9.122=0.267
iters=5
new-facts=6402
prior-facts=6402
mean5179.037-5178.908=0.128
σ0.079-0.263=-0.184
min5178.968-5178.625=0.343
max5179.124-5179.149=-0.025
mean3219.400-3250.600=-31.200
σ389.498-328.141=61.357
min2684.000-2844.000=-160.000
max3707.000-3695.000=12.000
mean9.788-9.855=-0.067
σ0.198-0.323=-0.125
min9.584-9.463=0.120
max10.061-10.222=-0.161

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.802-1.076=0.726
σ0.123-0.109=0.013
min1.652-0.944=0.708
max1.989-1.249=0.740

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.197-463.205=-0.007
σ572.647-572.653=-0.006
min176.871-176.873=-0.003
max1322.168-1322.184=-0.016
mean77.500
σ7.000
min74.000
max88.000
mean2471.000-2844.000=-373.000
σ0.000
min2471.000-2844.000=-373.000
max2471.000-2844.000=-373.000
mean0.561-0.435=0.125
σ0.559-0.304=0.256
min0.276-0.282=-0.006
max1.400-0.891=0.509
policies=20
mean1768.972-1769.005=-0.032
σ0.344-0.331=0.012
min1768.761-1768.773=-0.013
max1769.485-1769.494=-0.009
mean740.000
σ0.000
min740.000
max740.000
mean2471.000-2844.000=-373.000
σ0.000
min2471.000-2844.000=-373.000
max2471.000-2844.000=-373.000
mean2.752-2.824=-0.071
σ0.031-0.009=0.022
min2.723-2.811=-0.089
max2.796-2.831=-0.035
policies=200
mean17696.159-17696.164=-0.005
σ0.404-0.533=-0.130
min17695.863-17695.728=0.135
max17696.753-17696.910=-0.156
mean7400.000
σ0.000
min7400.000
max7400.000
mean2471.000-2844.000=-373.000
σ0.000
min2471.000-2844.000=-373.000
max2471.000-2844.000=-373.000
mean27.668-28.069=-0.401
σ0.186-0.545=-0.360
min27.461-27.509=-0.048
max27.862-28.609=-0.747