Compare commits

Home / Compare 6e6625e3 .. 8777fad0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.571-35.572=-0.000
σ0.055-0.055=0.000
min35.540-35.547=-0.007
max35.727-35.727=0.000
mean416.000-414.900=1.100
σ0.000-0.316=-0.316
min416.000-414.000=2.000
max416.000-415.000=1.000
mean0.083-0.085=-0.003
σ0.005-0.004=0.001
min0.076-0.081=-0.005
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean24.001-24.001=0.000
σ0.002-0.004=-0.002
min23.998-23.994=0.003
max24.005-24.005=0.000
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.068-0.066=0.002
σ0.003-0.004=-0.001
min0.065-0.061=0.004
max0.074-0.074=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.503-1756.504=-0.002
σ0.364-0.365=-0.001
min1755.930-1755.927=0.003
max1757.095-1757.094=0.002
mean1653.250-1629.100=24.150
σ631.991-587.918=44.073
min679.000-638.000=41.000
max2826.000-2419.000=407.000
mean2.368-2.347=0.021
σ0.091-0.085=0.006
min2.259-2.234=0.025
max2.603-2.512=0.090

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.733-324.740=-0.007
σ0.056-0.040=0.016
min324.635-324.669=-0.034
max324.775-324.762=0.013
mean2826.000-2419.000=407.000
σ0.000
min2826.000-2419.000=407.000
max2826.000-2419.000=407.000
mean0.424-0.423=0.001
σ0.002-0.002=0.000
min0.422-0.422=0.000
max0.426-0.425=0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.293-1985.295=-0.003
σ0.013-0.012=0.001
min1985.277-1985.273=0.003
max1985.308-1985.304=0.003
mean2826.000-2419.000=407.000
σ0.000
min2826.000-2419.000=407.000
max2826.000-2419.000=407.000
mean2.629-2.644=-0.016
σ0.105-0.111=-0.006
min2.542-2.533=0.009
max2.763-2.762=0.002
iters=5
new-facts=6402
prior-facts=1
mean4808.930-4808.672=0.258
σ7.625-7.807=-0.183
min4805.424-4804.417=1.007
max4822.568-4822.615=-0.047
mean2826.000-2419.000=407.000
σ0.000
min2826.000-2419.000=407.000
max2826.000-2419.000=407.000
mean8.923-8.589=0.334
σ0.447-0.552=-0.104
min8.257-7.740=0.516
max9.505-9.141=0.363
iters=5
new-facts=6402
prior-facts=6402
mean4996.358-4996.506=-0.148
σ0.335-0.025=0.310
min4995.760-4996.472=-0.712
max4996.525-4996.529=-0.004
mean3056.000-2913.600=142.400
σ301.025-380.133=-79.108
min2826.000-2423.000=403.000
max3518.000-3408.000=110.000
mean8.468-8.562=-0.094
σ0.063-0.160=-0.097
min8.413-8.418=-0.005
max8.565-8.748=-0.183

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.951-1.638=-0.687
σ0.057-0.136=-0.079
min0.918-1.514=-0.596
max1.052-1.824=-0.771

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.967-462.965=0.001
σ574.250-574.248=0.002
min175.836-175.835=0.002
max1324.341-1324.337=0.004
mean86.250
σ8.500
min82.000
max99.000
mean2826.000-2419.000=407.000
σ0.000
min2826.000-2419.000=407.000
max2826.000-2419.000=407.000
mean0.431-0.556=-0.125
σ0.299-0.566=-0.266
min0.279-0.269=0.009
max0.880-1.404=-0.524
policies=20
mean1758.726-1758.684=0.042
σ0.347-0.342=0.004
min1758.499-1758.445=0.054
max1759.240-1759.190=0.051
mean820.000
σ0.000
min820.000
max820.000
mean2826.000-2419.000=407.000
σ0.000
min2826.000-2419.000=407.000
max2826.000-2419.000=407.000
mean2.783-2.717=0.066
σ0.006-0.012=-0.006
min2.776-2.699=0.077
max2.790-2.728=0.062
policies=200
mean17594.237-17594.274=-0.037
σ0.592-0.508=0.084
min17593.748-17593.988=-0.240
max17595.077-17595.034=0.043
mean8200.000
σ0.000
min8200.000
max8200.000
mean2826.000-2419.000=407.000
σ0.000
min2826.000-2419.000=407.000
max2826.000-2419.000=407.000
mean27.812-27.452=0.360
σ0.366-0.119=0.247
min27.483-27.355=0.128
max28.240-27.617=0.624