Compare commits

Home / Compare 6e6b2897 .. 5c07d388

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.244=-0.000
σ0.054-0.055=-0.001
min35.214-35.218=-0.004
max35.396-35.398=-0.002
mean414.000-414.200=-0.200
σ0.000-0.422=-0.422
min414.000
max414.000-415.000=-1.000
mean0.084-0.085=-0.002
σ0.006-0.003=0.003
min0.076-0.082=-0.005
max0.094-0.091=0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=-0.000
σ0.002-0.003=-0.001
min23.766-23.764=0.002
max23.773-23.774=-0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.067-0.068=-0.001
σ0.002-0.003=-0.001
min0.065-0.066=-0.001
max0.073-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.486=-0.001
σ0.364-0.365=-0.001
min1755.910-1755.910=0.000
max1757.074-1757.077=-0.003
mean1648.350-1650.200=-1.850
σ639.641-639.571=0.070
min625.000-628.000=-3.000
max2824.000-2827.000=-3.000
mean2.343-2.339=0.004
σ0.087-0.092=-0.005
min2.150-2.151=-0.001
max2.489-2.584=-0.095

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.712-324.708=0.003
σ0.036-0.048=-0.012
min324.648-324.624=0.024
max324.740-324.741=-0.001
mean2824.000-2827.000=-3.000
σ0.000
min2824.000-2827.000=-3.000
max2824.000-2827.000=-3.000
mean0.422-0.423=-0.001
σ0.001-0.001=-0.000
min0.421-0.421=-0.000
max0.423-0.425=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.265-1985.260=0.005
σ0.008-0.016=-0.008
min1985.252-1985.242=0.009
max1985.271-1985.275=-0.003
mean2824.000-2827.000=-3.000
σ0.000
min2824.000-2827.000=-3.000
max2824.000-2827.000=-3.000
mean2.582-2.590=-0.008
σ0.060-0.041=0.019
min2.529-2.552=-0.023
max2.670-2.657=0.013
iters=5
new-facts=6402
prior-facts=1
mean4808.867-4808.655=0.212
σ7.656-7.792=-0.136
min4805.359-4804.784=0.574
max4822.563-4822.578=-0.015
mean2824.000-2827.000=-3.000
σ0.000
min2824.000-2827.000=-3.000
max2824.000-2827.000=-3.000
mean8.726-8.637=0.089
σ0.217-0.555=-0.339
min8.462-7.682=0.780
max9.013-9.045=-0.032
iters=5
new-facts=6402
prior-facts=6402
mean4996.472-4996.463=0.009
σ0.018-0.018=0.001
min4996.447-4996.443=0.004
max4996.492-4996.481=0.011
mean3041.000-3046.800=-5.800
σ190.653-199.416=-8.763
min2824.000-2827.000=-3.000
max3313.000-3335.000=-22.000
mean8.898-8.783=0.115
σ0.306-0.434=-0.128
min8.539-8.427=0.112
max9.375-9.493=-0.117

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.942-0.945=-0.003
σ0.055-0.058=-0.003
min0.906-0.911=-0.006
max1.038-1.046=-0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.961-462.965=-0.004
σ574.250-574.249=0.001
min175.830-175.834=-0.004
max1324.336-1324.338=-0.002
mean86.250
σ8.500
min82.000
max99.000
mean2824.000-2827.000=-3.000
σ0.000
min2824.000-2827.000=-3.000
max2824.000-2827.000=-3.000
mean0.428-0.430=-0.002
σ0.294-0.295=-0.001
min0.277-0.278=-0.001
max0.868-0.873=-0.004
policies=20
mean1758.690-1758.726=-0.036
σ0.348-0.343=0.006
min1758.462-1758.498=-0.036
max1759.207-1759.232=-0.025
mean820.000
σ0.000
min820.000
max820.000
mean2824.000-2827.000=-3.000
σ0.000
min2824.000-2827.000=-3.000
max2824.000-2827.000=-3.000
mean2.785-2.807=-0.022
σ0.022-0.030=-0.008
min2.771-2.783=-0.012
max2.818-2.851=-0.033
policies=200
mean17593.188-17593.143=0.045
σ0.626-0.799=-0.173
min17592.316-17592.035=0.282
max17593.693-17593.855=-0.162
mean8200.000
σ0.000
min8200.000
max8200.000
mean2824.000-2827.000=-3.000
σ0.000
min2824.000-2827.000=-3.000
max2824.000-2827.000=-3.000
mean27.778-27.815=-0.037
σ0.343-0.330=0.013
min27.451-27.507=-0.056
max28.139-28.219=-0.080