Compare commits

Home / Compare c8a34b62 .. 4c38b8ad

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.980=-0.002
σ0.050-0.049=0.000
min33.951-33.947=0.004
max34.115-34.116=-0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.082-0.084=-0.002
σ0.006-0.006=0.001
min0.077-0.079=-0.002
max0.095-0.093=0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.001
σ0.002-0.003=-0.001
min23.313-23.312=0.002
max23.321-23.321=0.000
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.065-0.064=0.001
σ0.003-0.003=-0.000
min0.064-0.061=0.002
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.304-1757.301=0.003
σ0.365-0.364=0.001
min1756.728-1756.727=0.001
max1757.896-1757.891=0.005
mean1658.350-1664.150=-5.800
σ620.616-628.408=-7.792
min668.000-669.000=-1.000
max2587.000-2613.000=-26.000
mean2.354-2.369=-0.015
σ0.094-0.136=-0.042
min2.179-2.258=-0.079
max2.600-2.762=-0.161

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.445-326.449=-0.004
σ0.047-0.038=0.010
min326.363-326.382=-0.019
max326.484-326.472=0.011
mean2587.000-2613.000=-26.000
σ0.000
min2587.000-2613.000=-26.000
max2587.000-2613.000=-26.000
mean0.423-0.424=-0.001
σ0.001-0.001=-0.000
min0.422-0.423=-0.001
max0.424-0.426=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1988.617-1988.613=0.004
σ0.005-0.009=-0.004
min1988.610-1988.598=0.012
max1988.624-1988.623=0.000
mean2587.000-2613.000=-26.000
σ0.000
min2587.000-2613.000=-26.000
max2587.000-2613.000=-26.000
mean2.736-2.676=0.060
σ0.154-0.078=0.076
min2.561-2.562=-0.001
max2.960-2.763=0.197
iters=5
new-facts=6402
prior-facts=1
mean4813.346-4813.456=-0.110
σ7.792-7.732=0.060
min4809.398-4809.946=-0.548
max4827.276-4827.287=-0.011
mean2587.000-2613.000=-26.000
σ0.000
min2587.000-2613.000=-26.000
max2587.000-2613.000=-26.000
mean8.972-8.944=0.029
σ0.243-0.246=-0.003
min8.716-8.655=0.061
max9.239-9.200=0.039
iters=5
new-facts=6402
prior-facts=6402
mean5001.010-5001.005=0.005
σ0.022-0.020=0.002
min5000.986-5000.981=0.005
max5001.041-5001.025=0.016
mean2999.800-3000.000=-0.200
σ312.059-279.022=33.037
min2587.000-2613.000=-26.000
max3405.000-3312.000=93.000
mean9.416-9.605=-0.190
σ0.542-0.435=0.107
min8.517-8.833=-0.316
max9.975-9.857=0.118

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.179-1.305=-0.126
σ0.326-0.369=-0.043
min0.925-0.916=0.009
max1.725-1.811=-0.085

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.439-464.434=0.005
σ574.785-574.776=0.009
min177.039-177.041=-0.002
max1326.616-1326.598=0.018
mean88.250
σ8.500
min84.000
max101.000
mean2587.000-2613.000=-26.000
σ0.000
min2587.000-2613.000=-26.000
max2587.000-2613.000=-26.000
mean0.544-0.542=0.003
σ0.538-0.543=-0.004
min0.273-0.260=0.013
max1.352-1.356=-0.004
policies=20
mean1770.765-1770.763=0.002
σ0.357-0.361=-0.004
min1770.531-1770.527=0.004
max1771.296-1771.300=-0.005
mean840.000
σ0.000
min840.000
max840.000
mean2587.000-2613.000=-26.000
σ0.000
min2587.000-2613.000=-26.000
max2587.000-2613.000=-26.000
mean2.727-2.733=-0.006
σ0.028-0.031=-0.003
min2.705-2.692=0.013
max2.767-2.764=0.003
policies=200
mean17714.940-17714.939=0.001
σ0.388-0.464=-0.076
min17714.727-17714.694=0.033
max17715.521-17715.635=-0.113
mean8400.000
σ0.000
min8400.000
max8400.000
mean2587.000-2613.000=-26.000
σ0.000
min2587.000-2613.000=-26.000
max2587.000-2613.000=-26.000
mean27.483-27.512=-0.029
σ0.133-0.210=-0.077
min27.340-27.349=-0.009
max27.611-27.805=-0.194