Compare commits

Home / Compare efe65dd9 .. ed536a9b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.264=0.354
σ0.055-0.053=0.002
min35.588-35.238=0.350
max35.773-35.413=0.360
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.085-0.085=-0.001
σ0.003-0.003=-0.000
min0.082-0.083=-0.000
max0.091-0.093=-0.002
cache=y
dps=1
iters=10
policies=100
mean24.046-23.769=0.278
σ0.003-0.002=0.001
min24.042-23.766=0.276
max24.051-23.772=0.280
mean415.000-412.700=2.300
σ0.000-0.483=-0.483
min415.000-412.000=3.000
max415.000-413.000=2.000
mean0.067-0.066=0.000
σ0.001-0.005=-0.004
min0.065-0.060=0.005
max0.068-0.075=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.492-1756.474=0.017
σ0.365-0.367=-0.002
min1755.916-1755.896=0.020
max1757.086-1757.067=0.019
mean1653.600-1643.600=10.000
σ628.843-609.650=19.193
min623.000-650.000=-27.000
max2703.000-2459.000=244.000
mean2.348-2.311=0.037
σ0.105-0.076=0.029
min2.187-2.210=-0.023
max2.649-2.531=0.118

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.757-324.694=0.063
σ0.058-0.045=0.013
min324.653-324.614=0.039
max324.790-324.720=0.070
mean2703.000-2459.000=244.000
σ0.000
min2703.000-2459.000=244.000
max2703.000-2459.000=244.000
mean0.438-0.425=0.013
σ0.015-0.001=0.014
min0.420-0.423=-0.003
max0.452-0.426=0.026
iters=5
new-facts=1
prior-facts=6402
mean1985.315-1985.250=0.065
σ0.013-0.013=-0.000
min1985.304-1985.228=0.076
max1985.330-1985.261=0.069
mean2703.000-2459.000=244.000
σ0.000
min2703.000-2459.000=244.000
max2703.000-2459.000=244.000
mean2.696-2.607=0.089
σ0.121-0.072=0.048
min2.605-2.545=0.060
max2.868-2.726=0.142
iters=5
new-facts=6402
prior-facts=1
mean4809.110-4808.796=0.314
σ7.679-7.683=-0.004
min4805.617-4804.904=0.712
max4822.847-4822.531=0.316
mean2703.000-2459.000=244.000
σ0.000
min2703.000-2459.000=244.000
max2703.000-2459.000=244.000
mean8.829-8.396=0.433
σ0.327-0.504=-0.176
min8.287-7.757=0.530
max9.091-8.913=0.178
iters=5
new-facts=6402
prior-facts=6402
mean4996.626-4996.449=0.177
σ0.027-0.017=0.009
min4996.592-4996.430=0.162
max4996.650-4996.468=0.182
mean3008.600-2949.600=59.000
σ353.964-442.776=-88.811
min2703.000-2459.000=244.000
max3525.000-3542.000=-17.000
mean8.536-8.530=0.006
σ0.080-0.163=-0.083
min8.488-8.409=0.079
max8.679-8.808=-0.129

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.971-1.505=-0.534
σ0.064-0.215=-0.151
min0.917-1.173=-0.256
max1.051-1.727=-0.676

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.208-462.930=0.277
σ574.773-574.257=0.516
min175.817-175.797=0.020
max1325.367-1324.316=1.051
mean86.250
σ8.500
min82.000
max99.000
mean2703.000-2459.000=244.000
σ0.000
min2703.000-2459.000=244.000
max2703.000-2459.000=244.000
mean0.543-0.547=-0.004
σ0.532-0.543=-0.011
min0.275-0.272=0.003
max1.340-1.361=-0.021
policies=20
mean1758.503-1758.295=0.208
σ0.327-0.337=-0.010
min1758.295-1758.053=0.242
max1758.990-1758.793=0.197
mean820.000
σ0.000
min820.000
max820.000
mean2703.000-2459.000=244.000
σ0.000
min2703.000-2459.000=244.000
max2703.000-2459.000=244.000
mean2.718-2.708=0.010
σ0.017-0.009=0.008
min2.698-2.700=-0.001
max2.739-2.720=0.019
policies=200
mean17592.070-17590.137=1.933
σ0.347-0.528=-0.181
min17591.874-17589.781=2.093
max17592.590-17590.910=1.680
mean8200.000
σ0.000
min8200.000
max8200.000
mean2703.000-2459.000=244.000
σ0.000
min2703.000-2459.000=244.000
max2703.000-2459.000=244.000
mean27.386-27.493=-0.107
σ0.106-0.120=-0.014
min27.243-27.351=-0.108
max27.484-27.631=-0.148