Compare commits

Home / Compare e34ec23b .. ae5cb0d3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.619-35.618=0.001
σ0.054-0.054=-0.000
min35.593-35.591=0.002
max35.772-35.771=0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.085-0.086=-0.000
σ0.006-0.003=0.003
min0.077-0.083=-0.006
max0.095-0.092=0.003
cache=y
dps=1
iters=10
policies=100
mean24.048-24.046=0.002
σ0.002-0.003=-0.001
min24.044-24.041=0.003
max24.053-24.051=0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.068-0.067=0.002
σ0.003-0.001=0.002
min0.066-0.065=0.001
max0.075-0.068=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.493=-0.003
σ0.365-0.365=-0.000
min1755.916-1755.916=0.000
max1757.077-1757.080=-0.004
mean1651.150-1626.100=25.050
σ628.863-592.413=36.450
min618.000-651.000=-33.000
max2706.000-2423.000=283.000
mean2.332-2.315=0.017
σ0.102-0.077=0.025
min2.223-2.231=-0.008
max2.613-2.493=0.120

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.763-324.775=-0.012
σ0.059-0.038=0.021
min324.658-324.707=-0.049
max324.797-324.798=-0.001
mean2706.000-2423.000=283.000
σ0.000
min2706.000-2423.000=283.000
max2706.000-2423.000=283.000
mean0.439-0.429=0.010
σ0.017-0.008=0.009
min0.422-0.423=-0.001
max0.461-0.441=0.019
iters=5
new-facts=1
prior-facts=6402
mean1985.319-1985.311=0.008
σ0.013-0.013=0.000
min1985.308-1985.299=0.009
max1985.336-1985.328=0.008
mean2706.000-2423.000=283.000
σ0.000
min2706.000-2423.000=283.000
max2706.000-2423.000=283.000
mean2.600-2.558=0.042
σ0.059-0.080=-0.021
min2.548-2.477=0.071
max2.678-2.665=0.013
iters=5
new-facts=6402
prior-facts=1
mean4808.967-4809.118=-0.151
σ7.733-7.637=0.096
min4805.046-4805.604=-0.558
max4822.791-4822.777=0.014
mean2706.000-2423.000=283.000
σ0.000
min2706.000-2423.000=283.000
max2706.000-2423.000=283.000
mean8.758-8.745=0.013
σ0.256-0.532=-0.276
min8.436-7.986=0.450
max9.066-9.449=-0.383
iters=5
new-facts=6402
prior-facts=6402
mean4996.627-4996.631=-0.004
σ0.023-0.021=0.003
min4996.601-4996.606=-0.005
max4996.652-4996.654=-0.002
mean3032.800-2900.600=132.200
σ249.713-403.860=-154.147
min2706.000-2423.000=283.000
max3368.000-3448.000=-80.000
mean8.665-8.488=0.177
σ0.193-0.121=0.073
min8.446-8.421=0.025
max8.891-8.703=0.188

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-1.807=-0.806
σ0.132-0.045=0.087
min0.915-1.737=-0.822
max1.213-1.861=-0.648

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.209-463.199=0.011
σ574.770-574.759=0.011
min175.819-175.815=0.003
max1325.364-1325.337=0.028
mean86.250
σ8.500
min82.000
max99.000
mean2706.000-2423.000=283.000
σ0.000
min2706.000-2423.000=283.000
max2706.000-2423.000=283.000
mean0.557-0.548=0.009
σ0.568-0.550=0.019
min0.270-0.272=-0.002
max1.410-1.372=0.037
policies=20
mean1758.491-1758.498=-0.007
σ0.338-0.355=-0.017
min1758.279-1758.264=0.015
max1758.995-1759.026=-0.031
mean820.000
σ0.000
min820.000
max820.000
mean2706.000-2423.000=283.000
σ0.000
min2706.000-2423.000=283.000
max2706.000-2423.000=283.000
mean2.706-2.723=-0.017
σ0.009-0.021=-0.012
min2.695-2.699=-0.004
max2.715-2.750=-0.035
policies=200
mean17591.789-17592.060=-0.270
σ0.545-0.484=0.061
min17591.437-17591.650=-0.212
max17592.601-17592.761=-0.161
mean8200.000
σ0.000
min8200.000
max8200.000
mean2706.000-2423.000=283.000
σ0.000
min2706.000-2423.000=283.000
max2706.000-2423.000=283.000
mean27.357-27.497=-0.140
σ0.134-0.157=-0.023
min27.226-27.327=-0.101
max27.512-27.675=-0.163