Compare commits

Home / Compare 40895c66 .. 07e2b9b8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727-36.725=0.002
σ0.848-0.595=0.253
min35.924-35.926=-0.001
max38.435-37.226=1.209
mean3979.000-4005.000=-26.000
σ0.000
min3979.000-4005.000=-26.000
max3979.000-4005.000=-26.000
mean0.076-0.076=0.001
σ0.002-0.001=0.001
min0.074-0.075=-0.000
max0.081-0.077=0.004
cache=y
dps=1
iters=10
policies=100
mean26.580-26.586=-0.007
σ0.606-0.603=0.003
min26.187-26.207=-0.021
max27.463-27.465=-0.002
mean3979.000-4005.000=-26.000
σ0.000
min3979.000-4005.000=-26.000
max3979.000-4005.000=-26.000
mean0.060-0.061=-0.000
σ0.002-0.001=0.001
min0.056-0.059=-0.003
max0.062-0.062=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.367-1756.367=-0.000
σ0.371-0.373=-0.002
min1755.798-1755.795=0.003
max1756.953-1756.965=-0.012
mean1666.700-1654.400=12.300
σ646.226-627.268=18.958
min629.000-681.000=-52.000
max2857.000-2604.000=253.000
mean2.260-2.269=-0.009
σ0.152-0.150=0.002
min2.094-2.132=-0.037
max2.835-2.801=0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.695-278.696=-0.001
σ0.014-0.014=0.000
min278.682-278.684=-0.002
max278.719-278.718=0.001
mean2857.000-2604.000=253.000
σ0.000
min2857.000-2604.000=253.000
max2857.000-2604.000=253.000
mean0.417-0.417=-0.000
σ0.001-0.002=-0.000
min0.415-0.415=-0.000
max0.418-0.419=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.872-2268.860=0.012
σ0.005-0.012=-0.006
min2268.867-2268.840=0.026
max2268.880-2268.868=0.011
mean2857.000-2604.000=253.000
σ0.000
min2857.000-2604.000=253.000
max2857.000-2604.000=253.000
mean2.931-3.038=-0.107
σ0.064-0.299=-0.235
min2.849-2.899=-0.049
max3.022-3.573=-0.551
iters=5
new-facts=6402
prior-facts=1
mean4952.375-4952.362=0.013
σ0.747-0.847=-0.100
min4951.994-4951.891=0.103
max4953.708-4953.873=-0.165
mean2857.000-2604.000=253.000
σ0.000
min2857.000-2604.000=253.000
max2857.000-2604.000=253.000
mean7.661-7.925=-0.264
σ0.129-0.251=-0.122
min7.545-7.706=-0.161
max7.865-8.344=-0.479
iters=5
new-facts=6402
prior-facts=6402
mean5167.072-5167.084=-0.013
σ0.010-0.024=-0.015
min5167.063-5167.068=-0.005
max5167.084-5167.127=-0.044
mean3404.600-3353.000=51.600
σ434.963-447.516=-12.553
min2857.000-2832.000=25.000
max3979.000-4005.000=-26.000
mean9.328-9.450=-0.122
σ0.243-0.491=-0.248
min8.958-8.999=-0.041
max9.624-10.283=-0.659

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.080-1.058=0.022
σ0.114-0.125=-0.011
min0.936-0.944=-0.008
max1.255-1.248=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.259-460.261=-0.002
σ572.607-572.608=-0.000
min173.954-173.957=-0.003
max1319.170-1319.173=-0.002
mean79.500
σ7.000
min76.000
max90.000
mean438.000
σ0.000
min438.000
max438.000
mean0.540-0.552=-0.012
σ0.537-0.560=-0.023
min0.270-0.267=0.003
max1.346-1.392=-0.046
policies=20
mean1740.053-1740.065=-0.012
σ0.336-0.333=0.004
min1739.812-1739.824=-0.013
max1740.546-1740.553=-0.007
mean760.000
σ0.000
min760.000
max760.000
mean447.750-447.000=0.750
σ9.605-9.274=0.331
min438.000
max456.000-455.000=1.000
mean2.657-2.660=-0.003
σ0.012-0.008=0.004
min2.642-2.652=-0.010
max2.671-2.671=-0.000
policies=200
mean17409.954-17409.950=0.004
σ0.057-0.084=-0.028
min17409.890-17409.831=0.059
max17410.027-17410.025=0.002
mean7600.000
σ0.000
min7600.000
max7600.000
mean492.000-490.000=2.000
σ2.449-2.582=-0.132
min490.000-487.000=3.000
max495.000-493.000=2.000
mean26.807-26.884=-0.077
σ0.126-0.151=-0.026
min26.650-26.695=-0.045
max26.915-27.059=-0.144