Compare commits

Home / Compare ca70824e .. e345a4b0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.262=0.356
σ0.054-0.054=-0.000
min35.593-35.232=0.361
max35.771-35.415=0.356
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.085-0.083=0.002
σ0.003-0.005=-0.001
min0.082-0.078=0.005
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.048-23.768=0.280
σ0.002-0.002=0.001
min24.045-23.766=0.279
max24.052-23.772=0.280
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.068-0.067=0.001
σ0.003-0.003=-0.001
min0.066-0.061=0.004
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.471=0.019
σ0.365-0.365=-0.001
min1755.917-1755.893=0.024
max1757.080-1757.057=0.023
mean1654.000-1647.200=6.800
σ641.406-639.606=1.800
min630.000-624.000=6.000
max2847.000-2824.000=23.000
mean2.365-2.331=0.034
σ0.113-0.089=0.023
min2.233-2.201=0.032
max2.624-2.566=0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.694=0.068
σ0.056-0.047=0.010
min324.662-324.612=0.051
max324.800-324.727=0.074
mean2847.000-2824.000=23.000
σ0.000
min2847.000-2824.000=23.000
max2847.000-2824.000=23.000
mean0.432-0.429=0.003
σ0.008-0.007=0.001
min0.422-0.422=-0.000
max0.440-0.439=0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.252=0.066
σ0.016-0.013=0.004
min1985.291-1985.237=0.054
max1985.330-1985.265=0.065
mean2847.000-2824.000=23.000
σ0.000
min2847.000-2824.000=23.000
max2847.000-2824.000=23.000
mean2.621-2.593=0.028
σ0.068-0.108=-0.040
min2.551-2.452=0.099
max2.715-2.742=-0.027
iters=5
new-facts=6402
prior-facts=1
mean4809.106-4808.535=0.571
σ7.628-7.903=-0.276
min4805.595-4804.188=1.407
max4822.749-4822.637=0.113
mean2847.000-2824.000=23.000
σ0.000
min2847.000-2824.000=23.000
max2847.000-2824.000=23.000
mean8.935-8.566=0.369
σ0.456-0.664=-0.208
min8.367-7.769=0.599
max9.633-9.134=0.498
iters=5
new-facts=6402
prior-facts=6402
mean4996.629-4996.384=0.245
σ0.023-0.165=-0.143
min4996.598-4996.090=0.508
max4996.653-4996.471=0.182
mean3056.600-3040.400=16.200
σ226.085-291.934=-65.849
min2847.000-2824.000=23.000
max3393.000-3498.000=-105.000
mean8.751-8.505=0.247
σ0.170-0.106=0.063
min8.496-8.419=0.076
max8.958-8.685=0.274

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.923-0.988=-0.066
σ0.014-0.153=-0.139
min0.912-0.915=-0.003
max0.947-1.261=-0.315

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.208-462.955=0.252
σ574.766-574.257=0.509
min175.818-175.813=0.005
max1325.356-1324.341=1.015
mean86.250
σ8.500
min82.000
max99.000
mean2847.000-2824.000=23.000
σ0.000
min2847.000-2824.000=23.000
max2847.000-2824.000=23.000
mean0.423-0.538=-0.115
σ0.292-0.512=-0.220
min0.271-0.278=-0.008
max0.861-1.306=-0.445
policies=20
mean1758.519-1758.474=0.045
σ0.350-0.364=-0.015
min1758.301-1758.224=0.077
max1759.040-1759.014=0.026
mean820.000
σ0.000
min820.000
max820.000
mean2847.000-2824.000=23.000
σ0.000
min2847.000-2824.000=23.000
max2847.000-2824.000=23.000
mean2.780-2.780=0.001
σ0.007-0.012=-0.004
min2.771-2.771=0.000
max2.788-2.797=-0.009
policies=200
mean17592.188-17591.114=1.074
σ0.486-0.713=-0.227
min17591.867-17590.142=1.725
max17592.911-17591.686=1.225
mean8200.000
σ0.000
min8200.000
max8200.000
mean2847.000-2824.000=23.000
σ0.000
min2847.000-2824.000=23.000
max2847.000-2824.000=23.000
mean27.898-27.880=0.019
σ0.342-0.268=0.074
min27.428-27.627=-0.199
max28.189-28.217=-0.029