Compare commits

Home / Compare 1aed7b18 .. 72287c28

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.245=-0.001
σ0.054-0.054=-0.000
min35.216-35.219=-0.002
max35.396-35.399=-0.003
mean411.000
σ0.000
min411.000
max411.000
mean0.086-0.085=0.001
σ0.005-0.004=0.001
min0.082-0.082=-0.000
max0.095-0.093=0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.001
σ0.002-0.004=-0.001
min23.766-23.762=0.004
max23.773-23.774=-0.002
mean411.000
σ0.000
min411.000
max411.000
mean0.068-0.069=-0.001
σ0.003-0.003=-0.000
min0.066-0.067=-0.001
max0.075-0.075=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1718.440=38.046
σ0.366-169.735=-169.369
min1755.908-997.318=758.590
max1757.076-1756.950=0.126
mean1649.450-1585.250=64.200
σ642.703-601.010=41.694
min623.000-624.000=-1.000
max2832.000-2408.000=424.000
mean2.335-2.272=0.063
σ0.084-0.203=-0.118
min2.250-1.443=0.806
max2.564-2.410=0.154

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.687-324.582=0.105
σ0.049-0.053=-0.004
min324.602-324.488=0.114
max324.726-324.614=0.113
mean2832.000-2408.000=424.000
σ0.000
min2832.000-2408.000=424.000
max2832.000-2408.000=424.000
mean0.432-0.425=0.007
σ0.012-0.001=0.010
min0.426-0.423=0.003
max0.453-0.426=0.026
iters=5
new-facts=1
prior-facts=6402
mean1985.270-1985.118=0.152
σ0.005-0.019=-0.013
min1985.264-1985.098=0.165
max1985.278-1985.148=0.130
mean2832.000-2408.000=424.000
σ0.000
min2832.000-2408.000=424.000
max2832.000-2408.000=424.000
mean2.608-2.664=-0.056
σ0.146-0.113=0.033
min2.433-2.531=-0.097
max2.812-2.801=0.011
iters=5
new-facts=6402
prior-facts=1
mean4808.886-4808.690=0.196
σ7.749-7.687=0.063
min4805.383-4804.669=0.714
max4822.748-4822.425=0.323
mean2832.000-2408.000=424.000
σ0.000
min2832.000-2408.000=424.000
max2832.000-2408.000=424.000
mean8.970-8.792=0.178
σ0.446-0.687=-0.241
min8.433-7.700=0.733
max9.629-9.513=0.117
iters=5
new-facts=6402
prior-facts=6402
mean4996.395-4996.346=0.049
σ0.143-0.012=0.132
min4996.140-4996.331=-0.190
max4996.485-4996.359=0.127
mean3051.200-2894.800=156.400
σ228.650-393.672=-165.022
min2832.000-2408.000=424.000
max3378.000-3411.000=-33.000
mean8.688-8.460=0.228
σ0.252-0.071=0.181
min8.404-8.378=0.026
max9.051-8.541=0.511

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.049-1.453=-0.404
σ0.189-0.209=-0.021
min0.911-1.120=-0.210
max1.275-1.663=-0.387

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.976-462.948=0.028
σ574.253-574.255=-0.002
min175.839-175.819=0.020
max1324.355-1324.331=0.024
mean86.250
σ8.500
min82.000
max99.000
mean2832.000-2408.000=424.000
σ0.000
min2832.000-2408.000=424.000
max2832.000-2408.000=424.000
mean0.469-0.551=-0.082
σ0.373-0.557=-0.184
min0.280-0.271=0.010
max1.028-1.387=-0.359
policies=20
mean1758.720-1758.512=0.208
σ0.350-0.324=0.026
min1758.488-1758.270=0.217
max1759.237-1758.988=0.249
mean820.000
σ0.000
min820.000
max820.000
mean2832.000-2408.000=424.000
σ0.000
min2832.000-2408.000=424.000
max2832.000-2408.000=424.000
mean2.817-2.691=0.126
σ0.009-0.017=-0.009
min2.804-2.668=0.137
max2.824-2.704=0.120
policies=200
mean17593.196-17592.478=0.718
σ0.606-0.473=0.133
min17592.324-17592.192=0.132
max17593.632-17593.185=0.447
mean8200.000
σ0.000
min8200.000
max8200.000
mean2832.000-2408.000=424.000
σ0.000
min2832.000-2408.000=424.000
max2832.000-2408.000=424.000
mean28.000-27.451=0.548
σ0.345-0.200=0.146
min27.644-27.277=0.367
max28.394-27.709=0.685