Compare commits

Home / Compare 3b15a8f8 .. 0ccb444b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.976=0.003
σ0.049-0.047=0.003
min33.948-33.952=-0.004
max34.114-34.107=0.007
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.085-0.080=0.005
σ0.003-0.006=-0.002
min0.082-0.075=0.007
max0.092-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.003-0.004=-0.000
min23.315-23.312=0.003
max23.323-23.323=0.000
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.065-0.063=0.002
σ0.003-0.003=-0.000
min0.063-0.060=0.003
max0.073-0.068=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.495-1757.495=0.000
σ0.365-0.365=-0.000
min1756.920-1756.920=-0.000
max1758.086-1758.086=-0.000
mean1676.150-1666.150=10.000
σ634.448-621.362=13.086
min665.000-672.000=-7.000
max2640.000-2592.000=48.000
mean2.383-2.346=0.037
σ0.096-0.083=0.013
min2.278-2.238=0.041
max2.599-2.528=0.071

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.633-326.641=-0.008
σ0.061-0.030=0.031
min326.526-326.590=-0.064
max326.672-326.663=0.009
mean2640.000-2592.000=48.000
σ0.000
min2640.000-2592.000=48.000
max2640.000-2592.000=48.000
mean0.431-0.424=0.007
σ0.009-0.004=0.005
min0.422-0.421=0.001
max0.445-0.430=0.015
iters=5
new-facts=1
prior-facts=6402
mean1988.795-1988.804=-0.009
σ0.014-0.009=0.005
min1988.780-1988.788=-0.009
max1988.811-1988.810=0.001
mean2640.000-2592.000=48.000
σ0.000
min2640.000-2592.000=48.000
max2640.000-2592.000=48.000
mean2.728-2.706=0.022
σ0.124-0.112=0.012
min2.614-2.588=0.026
max2.926-2.854=0.072
iters=5
new-facts=6402
prior-facts=1
mean4813.646-4813.526=0.120
σ7.733-7.775=-0.043
min4810.143-4809.630=0.513
max4827.478-4827.427=0.051
mean2640.000-2592.000=48.000
σ0.000
min2640.000-2592.000=48.000
max2640.000-2592.000=48.000
mean8.663-8.816=-0.153
σ0.520-0.157=0.364
min7.850-8.617=-0.767
max9.087-8.992=0.095
iters=5
new-facts=6402
prior-facts=6402
mean5001.058-5001.207=-0.149
σ0.197-0.033=0.164
min5000.826-5001.175=-0.348
max5001.224-5001.257=-0.034
mean2961.200-3005.000=-43.800
σ255.007-260.383=-5.376
min2640.000-2619.000=21.000
max3302.000-3312.000=-10.000
mean9.568-9.827=-0.259
σ0.203-0.161=0.041
min9.294-9.596=-0.301
max9.766-10.042=-0.276

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.110-1.250=-0.141
σ0.235-0.399=-0.164
min0.915-0.912=0.003
max1.496-1.765=-0.270

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.633-464.637=-0.003
σ574.778-574.790=-0.012
min177.234-177.234=0.000
max1326.800-1326.821=-0.021
mean88.250
σ8.500
min84.000
max101.000
mean2640.000-2592.000=48.000
σ0.000
min2640.000-2592.000=48.000
max2640.000-2592.000=48.000
mean0.548-0.563=-0.015
σ0.542-0.602=-0.060
min0.270-0.253=0.017
max1.360-1.466=-0.105
policies=20
mean1772.658-1772.679=-0.020
σ0.353-0.362=-0.009
min1772.426-1772.437=-0.010
max1773.183-1773.216=-0.033
mean840.000
σ0.000
min840.000
max840.000
mean2640.000-2592.000=48.000
σ0.000
min2640.000-2592.000=48.000
max2640.000-2592.000=48.000
mean2.715-2.727=-0.012
σ0.017-0.016=0.001
min2.699-2.714=-0.015
max2.738-2.750=-0.012
policies=200
mean17733.982-17733.993=-0.011
σ0.581-0.422=0.159
min17733.567-17733.685=-0.118
max17734.842-17734.616=0.226
mean8400.000
σ0.000
min8400.000
max8400.000
mean2640.000-2592.000=48.000
σ0.000
min2640.000-2592.000=48.000
max2640.000-2592.000=48.000
mean27.532-27.472=0.060
σ0.159-0.172=-0.014
min27.355-27.301=0.054
max27.730-27.626=0.104