Compare commits

Home / Compare f198055b .. 712c902e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.001
σ0.056-0.055=0.000
min35.587-35.587=-0.001
max35.775-35.773=0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.085-0.084=0.001
σ0.003-0.005=-0.002
min0.082-0.078=0.005
max0.091-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean24.047-24.047=-0.000
σ0.002-0.003=-0.001
min24.044-24.043=0.001
max24.049-24.051=-0.002
mean416.000
σ0.000
min416.000
max416.000
mean0.069-0.065=0.004
σ0.004-0.003=0.001
min0.066-0.061=0.005
max0.075-0.069=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.489=0.000
σ0.364-0.365=-0.000
min1755.915-1755.915=-0.000
max1757.075-1757.081=-0.006
mean1655.850
σ644.014-641.870=2.144
min635.000-623.000=12.000
max2843.000-2848.000=-5.000
mean2.332-2.354=-0.022
σ0.063-0.068=-0.005
min2.254-2.266=-0.012
max2.466-2.507=-0.041

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.738-324.762=-0.024
σ0.043-0.056=-0.013
min324.662-324.663=-0.001
max324.763-324.793=-0.031
mean2843.000-2848.000=-5.000
σ0.000
min2843.000-2848.000=-5.000
max2843.000-2848.000=-5.000
mean0.426-0.429=-0.003
σ0.005-0.009=-0.005
min0.423-0.424=-0.001
max0.434-0.445=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1985.322-1985.316=0.006
σ0.014-0.015=-0.001
min1985.300-1985.298=0.001
max1985.335-1985.332=0.003
mean2843.000-2848.000=-5.000
σ0.000
min2843.000-2848.000=-5.000
max2843.000-2848.000=-5.000
mean2.672-2.658=0.014
σ0.132-0.105=0.026
min2.520-2.567=-0.047
max2.872-2.778=0.094
iters=5
new-facts=6402
prior-facts=1
mean4809.089-4809.000=0.089
σ7.736-7.774=-0.038
min4805.605-4805.014=0.591
max4822.928-4822.897=0.031
mean2843.000-2848.000=-5.000
σ0.000
min2843.000-2848.000=-5.000
max2843.000-2848.000=-5.000
mean8.969-8.795=0.174
σ0.487-0.409=0.079
min8.245-8.075=0.170
max9.565-9.056=0.509
iters=5
new-facts=6402
prior-facts=6402
mean4996.566-4996.489=0.077
σ0.181-0.192=-0.011
min4996.247-4996.256=-0.010
max4996.674-4996.647=0.027
mean3086.000-3067.000=19.000
σ259.533-291.781=-32.248
min2843.000-2848.000=-5.000
max3358.000-3517.000=-159.000
mean9.158-8.543=0.616
σ0.551-0.132=0.419
min8.528-8.465=0.063
max9.899-8.777=1.122

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.068-1.009=0.059
σ0.264-0.118=0.146
min0.916-0.928=-0.012
max1.529-1.194=0.334

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.219-463.209=0.009
σ574.771-574.767=0.004
min175.821-175.816=0.006
max1325.376-1325.360=0.016
mean86.250
σ8.500
min82.000
max99.000
mean2843.000-2848.000=-5.000
σ0.000
min2843.000-2848.000=-5.000
max2843.000-2848.000=-5.000
mean0.421-0.435=-0.015
σ0.284-0.301=-0.018
min0.273-0.283=-0.010
max0.846-0.887=-0.041
policies=20
mean1758.533-1758.501=0.032
σ0.366-0.352=0.014
min1758.284-1758.253=0.031
max1759.075-1759.020=0.055
mean820.000
σ0.000
min820.000
max820.000
mean2843.000-2848.000=-5.000
σ0.000
min2843.000-2848.000=-5.000
max2843.000-2848.000=-5.000
mean2.786-2.791=-0.006
σ0.012-0.004=0.008
min2.771-2.786=-0.015
max2.798-2.795=0.003
policies=200
mean17592.089-17592.131=-0.042
σ0.498-0.512=-0.015
min17591.686-17591.834=-0.148
max17592.805-17592.897=-0.092
mean8200.000
σ0.000
min8200.000
max8200.000
mean2843.000-2848.000=-5.000
σ0.000
min2843.000-2848.000=-5.000
max2843.000-2848.000=-5.000
mean27.794-28.030=-0.236
σ0.317-0.376=-0.059
min27.446-27.662=-0.216
max28.168-28.494=-0.327