Compare commits

Home / Compare 5c31e563 .. 28ef3011

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.049-0.048=0.001
min33.952-33.948=0.004
max34.115-34.111=0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.085-0.084=0.001
σ0.003-0.004=-0.000
min0.082-0.082=0.000
max0.091-0.091=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.000
σ0.002-0.003=-0.001
min23.315-23.314=0.001
max23.321-23.323=-0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.063-0.065=-0.002
σ0.003-0.002=0.000
min0.060-0.064=-0.004
max0.067-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.430=-0.002
σ0.364-0.365=-0.001
min1756.853-1756.857=-0.004
max1758.014-1758.018=-0.004
mean1662.800-1648.000=14.800
σ621.359-625.368=-4.008
min670.000-637.000=33.000
max2592.000-2837.000=-245.000
mean2.379-2.375=0.004
σ0.122-0.077=0.045
min2.256-2.267=-0.010
max2.706-2.569=0.137

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.570-326.571=-0.000
σ0.051-0.048=0.002
min326.481-326.486=-0.005
max326.599-326.608=-0.009
mean2592.000-2837.000=-245.000
σ0.000
min2592.000-2837.000=-245.000
max2592.000-2837.000=-245.000
mean0.426-0.417=0.010
σ0.005-0.018=-0.013
min0.422-0.385=0.037
max0.433-0.427=0.006
iters=5
new-facts=1
prior-facts=6402
mean1988.739-1988.738=0.001
σ0.009-0.011=-0.002
min1988.724-1988.723=0.002
max1988.746-1988.748=-0.002
mean2592.000-2837.000=-245.000
σ0.000
min2592.000-2837.000=-245.000
max2592.000-2837.000=-245.000
mean2.685-2.688=-0.003
σ0.071-0.233=-0.162
min2.598-2.445=0.153
max2.765-3.071=-0.306
iters=5
new-facts=6402
prior-facts=1
mean4813.469-4813.602=-0.133
σ7.790-7.747=0.043
min4809.658-4810.039=-0.381
max4827.400-4827.460=-0.060
mean2592.000-2837.000=-245.000
σ0.000
min2592.000-2837.000=-245.000
max2592.000-2837.000=-245.000
mean8.925-8.481=0.444
σ0.249-0.590=-0.342
min8.539-7.831=0.707
max9.145-9.313=-0.168
iters=5
new-facts=6402
prior-facts=6402
mean5001.143-5001.138=0.005
σ0.045-0.019=0.026
min5001.083-5001.120=-0.037
max5001.196-5001.167=0.028
mean2962.600-3065.800=-103.200
σ271.738-309.824=-38.085
min2592.000-2837.000=-245.000
max3297.000-3547.000=-250.000
mean9.563-9.541=0.022
σ0.693-0.616=0.076
min8.429-8.503=-0.074
max10.151-10.087=0.064

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.183-0.971=0.211
σ0.383-0.064=0.318
min0.892-0.911=-0.019
max1.749-1.041=0.707

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.568-464.573=-0.004
σ574.780-574.772=0.008
min177.174-177.176=-0.002
max1326.738-1326.731=0.008
mean88.250
σ8.500
min84.000
max101.000
mean2592.000-2837.000=-245.000
σ0.000
min2592.000-2837.000=-245.000
max2592.000-2837.000=-245.000
mean0.581-0.432=0.150
σ0.618-0.305=0.313
min0.270-0.278=-0.007
max1.508-0.889=0.619
policies=20
mean1772.034-1772.043=-0.010
σ0.360-0.348=0.013
min1771.791-1771.827=-0.036
max1772.568-1772.559=0.009
mean840.000
σ0.000
min840.000
max840.000
mean2592.000-2837.000=-245.000
σ0.000
min2592.000-2837.000=-245.000
max2592.000-2837.000=-245.000
mean2.740-2.815=-0.075
σ0.054-0.021=0.033
min2.700-2.792=-0.092
max2.819-2.837=-0.018
policies=200
mean17727.549-17727.575=-0.026
σ0.493-0.525=-0.032
min17727.293-17727.216=0.077
max17728.288-17728.345=-0.056
mean8400.000
σ0.000
min8400.000
max8400.000
mean2592.000-2837.000=-245.000
σ0.000
min2592.000-2837.000=-245.000
max2592.000-2837.000=-245.000
mean27.457-28.014=-0.557
σ0.086-0.403=-0.317
min27.375-27.638=-0.263
max27.541-28.430=-0.889