Compare commits

Home / Compare 7a466e67 .. e447d946

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.616-35.617=-0.001
σ0.051-0.051=-0.000
min35.581-35.584=-0.003
max35.757-35.760=-0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.083-0.083=-0.000
σ0.006-0.005=0.001
min0.076-0.077=-0.001
max0.092-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.001
σ0.005-0.003=0.001
min24.041-24.042=-0.000
max24.059-24.051=0.008
mean414.700-414.000=0.700
σ0.483-0.000=0.483
min414.000
max415.000-414.000=1.000
mean0.068-0.069=-0.000
σ0.003-0.003=0.000
min0.066-0.066=-0.000
max0.075-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.062-1757.063=-0.001
σ0.364-0.365=-0.001
min1756.488-1756.488=-0.000
max1757.652-1757.651=0.001
mean1660.200-1647.450=12.750
σ622.068-627.401=-5.333
min669.000-637.000=32.000
max2597.000-2827.000=-230.000
mean2.386-2.350=0.036
σ0.145-0.092=0.052
min2.226-2.265=-0.039
max2.691-2.659=0.032

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean422.731-422.738=-0.007
σ0.076-0.077=-0.001
min422.596-422.600=-0.004
max422.773-422.777=-0.004
mean2597.000-2827.000=-230.000
σ0.000
min2597.000-2827.000=-230.000
max2597.000-2827.000=-230.000
mean0.572-0.578=-0.006
σ0.004-0.005=-0.001
min0.569-0.572=-0.003
max0.579-0.585=-0.006
iters=5
new-facts=1
prior-facts=6402
mean2122.009-2122.002=0.007
σ0.016-0.021=-0.005
min2121.991-2121.979=0.012
max2122.031-2122.029=0.002
mean2597.000-2827.000=-230.000
σ0.000
min2597.000-2827.000=-230.000
max2597.000-2827.000=-230.000
mean2.943-2.931=0.012
σ0.144-0.105=0.039
min2.752-2.762=-0.010
max3.098-3.015=0.083
iters=5
new-facts=6402
prior-facts=1
mean5109.835-5109.824=0.011
σ7.489-7.800=-0.311
min5106.443-5105.849=0.594
max5123.231-5123.767=-0.536
mean2597.000-2827.000=-230.000
σ0.000
min2597.000-2827.000=-230.000
max2597.000-2827.000=-230.000
mean9.507-9.373=0.134
σ0.271-0.315=-0.044
min9.078-9.003=0.076
max9.771-9.767=0.004
iters=5
new-facts=6402
prior-facts=6402
mean5295.002-5295.092=-0.090
σ0.304-0.171=0.133
min5294.462-5294.786=-0.324
max5295.183-5295.180=0.004
mean3044.400-3092.000=-47.600
σ356.867-297.511=59.355
min2597.000-2827.000=-230.000
max3518.000-3523.000=-5.000
mean9.249-9.374=-0.125
σ0.282-0.371=-0.089
min9.017-9.000=0.017
max9.571-9.910=-0.339

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.148-1.063=0.085
σ0.260-0.165=0.095
min0.927-0.928=-0.000
max1.525-1.335=0.190

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.266-464.268=-0.002
σ574.780-574.773=0.007
min176.869-176.871=-0.002
max1326.436-1326.427=0.009
mean88.250
σ8.500
min84.000
max101.000
mean2597.000-2827.000=-230.000
σ0.000
min2597.000-2827.000=-230.000
max2597.000-2827.000=-230.000
mean0.549-0.437=0.112
σ0.547-0.306=0.241
min0.273-0.282=-0.009
max1.369-0.897=0.472
policies=20
mean1769.017-1769.066=-0.049
σ0.354-0.369=-0.015
min1768.798-1768.805=-0.007
max1769.544-1769.609=-0.065
mean840.000
σ0.000
min840.000
max840.000
mean2597.000-2827.000=-230.000
σ0.000
min2597.000-2827.000=-230.000
max2597.000-2827.000=-230.000
mean2.738-2.825=-0.087
σ0.013-0.029=-0.016
min2.720-2.801=-0.081
max2.752-2.866=-0.114
policies=200
mean17697.553-17697.583=-0.030
σ0.490-0.493=-0.003
min17697.293-17697.231=0.061
max17698.287-17698.305=-0.018
mean8400.000
σ0.000
min8400.000
max8400.000
mean2597.000-2827.000=-230.000
σ0.000
min2597.000-2827.000=-230.000
max2597.000-2827.000=-230.000
mean27.583-28.097=-0.514
σ0.089-0.372=-0.284
min27.493-27.753=-0.260
max27.662-28.524=-0.862