Compare commits

Home / Compare 75f1ca3a .. 5c957f6d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.001
σ0.106-0.107=-0.001
min35.754-35.747=0.006
max36.098-36.101=-0.003
mean412.800-413.000=-0.200
σ0.422-0.000=0.422
min412.000-413.000=-1.000
max413.000
mean0.076-0.073=0.002
σ0.003-0.004=-0.001
min0.073-0.068=0.005
max0.082-0.079=0.003
cache=y
dps=1
iters=10
policies=100
mean26.064-26.064=-0.000
σ0.003-0.004=-0.001
min26.061-26.058=0.002
max26.068-26.070=-0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.059-0.061=-0.002
σ0.003-0.003=0.000
min0.056-0.060=-0.003
max0.067-0.070=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.922=0.001
σ0.365-0.370=-0.006
min1755.347-1755.357=-0.009
max1756.531-1756.514=0.016
mean1668.750-1649.050=19.700
σ638.783-607.276=31.507
min671.000-630.000=41.000
max2696.000-2464.000=232.000
mean2.739-2.804=-0.066
σ0.204-0.177=0.027
min2.283-2.291=-0.009
max2.994-3.002=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.172-277.178=-0.006
σ0.006-0.018=-0.011
min277.166-277.160=0.006
max277.181-277.201=-0.020
mean2696.000-2464.000=232.000
σ0.000
min2696.000-2464.000=232.000
max2696.000-2464.000=232.000
mean0.407-0.394=0.013
σ0.009-0.003=0.006
min0.401-0.391=0.010
max0.421-0.397=0.024
iters=5
new-facts=1
prior-facts=6402
mean2174.402-2174.447=-0.045
σ0.042-0.017=0.025
min2174.331-2174.425=-0.094
max2174.433-2174.471=-0.037
mean2696.000-2464.000=232.000
σ0.000
min2696.000-2464.000=232.000
max2696.000-2464.000=232.000
mean2.888-3.033=-0.145
σ0.180-0.126=0.054
min2.740-2.835=-0.096
max3.136-3.184=-0.048
iters=5
new-facts=6402
prior-facts=1
mean5052.585-5052.580=0.005
σ0.999-1.015=-0.016
min5052.058-5052.007=0.051
max5054.369-5054.387=-0.018
mean2696.000-2464.000=232.000
σ0.000
min2696.000-2464.000=232.000
max2696.000-2464.000=232.000
mean8.906-8.975=-0.069
σ0.646-0.492=0.154
min8.014-8.244=-0.229
max9.832-9.602=0.229
iters=5
new-facts=6402
prior-facts=6402
mean5188.352-5188.429=-0.077
σ0.127-0.082=0.045
min5188.167-5188.366=-0.199
max5188.526-5188.525=0.002
mean3285.600-3282.200=3.400
σ479.987-424.125=55.862
min2696.000-2683.000=13.000
max3876.000-3672.000=204.000
mean8.794-9.000=-0.205
σ0.164-0.385=-0.221
min8.669-8.781=-0.113
max9.042-9.686=-0.644

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.132-1.828=-0.696
σ0.176-0.122=0.054
min0.964-1.623=-0.659
max1.356-1.926=-0.571

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.858-464.845=0.014
σ572.672-572.651=0.021
min178.519-178.517=0.002
max1323.867-1323.821=0.045
mean79.500
σ7.000
min76.000
max90.000
mean2696.000-2464.000=232.000
σ0.000
min2696.000-2464.000=232.000
max2696.000-2464.000=232.000
mean0.568-0.573=-0.005
σ0.558-0.583=-0.025
min0.281-0.280=0.002
max1.405-1.448=-0.042
policies=20
mean1785.466-1785.446=0.020
σ0.351-0.356=-0.005
min1785.232-1785.209=0.022
max1785.987-1785.974=0.013
mean760.000
σ0.000
min760.000
max760.000
mean2696.000-2464.000=232.000
σ0.000
min2696.000-2464.000=232.000
max2696.000-2464.000=232.000
mean2.805-2.799=0.006
σ0.030-0.011=0.019
min2.782-2.783=-0.001
max2.847-2.807=0.039
policies=200
mean17861.480-17861.445=0.035
σ0.524-0.571=-0.048
min17861.070-17861.073=-0.003
max17862.248-17862.281=-0.033
mean7600.000
σ0.000
min7600.000
max7600.000
mean2696.000-2464.000=232.000
σ0.000
min2696.000-2464.000=232.000
max2696.000-2464.000=232.000
mean28.153-28.080=0.072
σ0.089-0.142=-0.053
min28.030-27.971=0.058
max28.241-28.289=-0.047