Compare commits

Home / Compare 397b5510 .. c6d0379e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.986=-0.008
σ0.047-0.053=-0.006
min33.950-33.956=-0.005
max34.109-34.136=-0.027
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.082-0.081=0.001
σ0.004-0.005=-0.001
min0.077-0.077=0.000
max0.088-0.088=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.324=-0.007
σ0.003-0.003=0.000
min23.311-23.319=-0.008
max23.323-23.330=-0.007
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.065-0.067=-0.002
σ0.003-0.002=0.000
min0.063-0.065=-0.002
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1756.726=0.576
σ0.365-0.364=0.002
min1756.731-1756.152=0.579
max1757.892-1757.317=0.575
mean1648.650-1631.250=17.400
σ629.347-627.321=2.026
min639.000-644.000=-5.000
max2822.000-2828.000=-6.000
mean2.367-2.398=-0.030
σ0.116-0.111=0.004
min2.262-2.272=-0.009
max2.773-2.666=0.107

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.445-325.321=1.124
σ0.061-0.042=0.019
min326.340-325.247=1.092
max326.494-325.350=1.144
mean2822.000-2828.000=-6.000
σ0.000
min2822.000-2828.000=-6.000
max2822.000-2828.000=-6.000
mean0.431-0.431=-0.000
σ0.010-0.005=0.005
min0.422-0.427=-0.005
max0.447-0.438=0.009
iters=5
new-facts=1
prior-facts=6402
mean1988.618-1985.873=2.746
σ0.008-0.013=-0.006
min1988.611-1985.851=2.759
max1988.630-1985.887=2.743
mean2822.000-2828.000=-6.000
σ0.000
min2822.000-2828.000=-6.000
max2822.000-2828.000=-6.000
mean2.716-2.704=0.012
σ0.064-0.101=-0.037
min2.622-2.591=0.031
max2.792-2.815=-0.023
iters=5
new-facts=6402
prior-facts=1
mean4813.371-4809.666=3.705
σ7.798-7.719=0.079
min4809.594-4806.134=3.460
max4827.318-4823.474=3.844
mean2822.000-2828.000=-6.000
σ0.000
min2822.000-2828.000=-6.000
max2822.000-2828.000=-6.000
mean8.605-9.126=-0.521
σ0.600-0.239=0.361
min7.973-8.874=-0.901
max9.234-9.421=-0.188
iters=5
new-facts=6402
prior-facts=6402
mean5000.866-4997.027=3.839
σ0.324-0.323=0.001
min5000.288-4996.455=3.833
max5001.044-4997.206=3.838
mean3064.400-3014.800=49.600
σ313.248-259.382=53.866
min2822.000-2828.000=-6.000
max3543.000-3424.000=119.000
mean9.508-8.561=0.947
σ0.425-0.083=0.341
min8.776-8.475=0.301
max9.783-8.696=1.087

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.958-0.924=0.033
σ0.098-0.013=0.085
min0.913-0.915=-0.002
max1.133-0.947=0.186

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.438-463.374=1.065
σ574.772-574.773=-0.002
min177.044-175.979=1.065
max1326.596-1325.534=1.062
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2822.000-2828.000=-6.000
σ0.000
min2822.000-2828.000=-6.000
max2822.000-2828.000=-6.000
mean0.433-0.470=-0.037
σ0.306-0.373=-0.067
min0.278-0.281=-0.003
max0.892-1.029=-0.137
policies=20
mean1770.769-1760.157=10.612
σ0.368-0.355=0.013
min1770.525-1759.908=10.617
max1771.316-1760.681=10.636
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2822.000-2828.000=-6.000
σ0.000
min2822.000-2828.000=-6.000
max2822.000-2828.000=-6.000
mean2.780-2.805=-0.026
σ0.016-0.013=0.004
min2.764-2.792=-0.028
max2.803-2.823=-0.020
policies=200
mean17714.883-17608.306=106.578
σ0.493-0.486=0.007
min17714.541-17607.919=106.622
max17715.615-17608.990=106.624
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2822.000-2828.000=-6.000
σ0.000
min2822.000-2828.000=-6.000
max2822.000-2828.000=-6.000
mean27.895-27.824=0.071
σ0.422-0.357=0.065
min27.535-27.436=0.099
max28.390-28.206=0.184