Compare commits

Home / Compare dfd47d68 .. ef6e448a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.952-35.951=0.001
σ0.102-0.103=-0.001
min35.909-35.904=0.005
max36.241-36.242=-0.001
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.077-0.074=0.003
σ0.003-0.004=-0.001
min0.075-0.070=0.005
max0.084-0.082=0.002
cache=y
dps=1
iters=10
policies=100
mean26.201-26.200=0.001
σ0.003-0.005=-0.001
min26.195-26.194=0.000
max26.208-26.208=-0.000
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.061-0.059=0.002
σ0.002-0.003=-0.001
min0.060-0.056=0.004
max0.068-0.068=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.300-1756.298=0.002
σ0.369-0.366=0.003
min1755.722-1755.724=-0.002
max1756.896-1756.891=0.005
mean1676.300-1654.100=22.200
σ636.668-637.194=-0.526
min679.000-607.000=72.000
max2690.000-2686.000=4.000
mean2.333-2.385=-0.052
σ0.082-0.125=-0.043
min2.232-2.268=-0.036
max2.532-2.797=-0.266

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.819-278.813=0.006
σ0.007-0.008=-0.001
min278.810-278.801=0.008
max278.828-278.822=0.007
mean2690.000-2686.000=4.000
σ0.000
min2690.000-2686.000=4.000
max2690.000-2686.000=4.000
mean0.409-0.411=-0.001
σ0.003-0.006=-0.002
min0.407-0.406=0.001
max0.415-0.418=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2268.878-2268.876=0.002
σ0.018-0.013=0.004
min2268.856-2268.858=-0.001
max2268.903-2268.893=0.010
mean2690.000-2686.000=4.000
σ0.000
min2690.000-2686.000=4.000
max2690.000-2686.000=4.000
mean3.040-2.899=0.141
σ0.152-0.060=0.092
min2.856-2.824=0.032
max3.248-2.978=0.270
iters=5
new-facts=6402
prior-facts=1
mean4954.265-4954.249=0.016
σ0.811-0.809=0.003
min4953.826-4953.755=0.071
max4955.709-4955.687=0.022
mean2690.000-2686.000=4.000
σ0.000
min2690.000-2686.000=4.000
max2690.000-2686.000=4.000
mean7.890-7.907=-0.017
σ0.294-0.265=0.030
min7.592-7.633=-0.042
max8.343-8.283=0.060
iters=5
new-facts=6402
prior-facts=6402
mean5168.790-5168.713=0.077
σ0.078-0.121=-0.043
min5168.726-5168.527=0.199
max5168.878-5168.865=0.013
mean3377.000-3361.600=15.400
σ524.520-464.851=59.669
min2908.000-2744.000=164.000
max4130.000-3978.000=152.000
mean9.293-9.133=0.160
σ0.319-0.442=-0.124
min8.769-8.382=0.387
max9.637-9.502=0.135

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.075-1.137=-0.062
σ0.161-0.357=-0.196
min0.939-0.939=-0.000
max1.342-1.768=-0.426

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.806-459.810=-0.004
σ571.584-571.585=-0.001
min174.010-174.009=0.001
max1317.182-1317.187=-0.005
mean79.500
σ7.000
min76.000
max90.000
mean2690.000-2686.000=4.000
σ0.000
min2690.000-2686.000=4.000
max2690.000-2686.000=4.000
mean0.550-0.538=0.012
σ0.558-0.543=0.015
min0.262-0.265=-0.003
max1.386-1.352=0.034
policies=20
mean1740.318-1740.322=-0.004
σ0.311-0.316=-0.004
min1740.121-1740.122=-0.000
max1740.783-1740.793=-0.010
mean760.000
σ0.000
min760.000
max760.000
mean2690.000-2686.000=4.000
σ0.000
min2690.000-2686.000=4.000
max2690.000-2686.000=4.000
mean2.672-2.674=-0.002
σ0.011-0.019=-0.008
min2.661-2.662=-0.002
max2.682-2.702=-0.020
policies=200
mean17410.101-17410.059=0.041
σ0.422-0.503=-0.081
min17409.779-17409.766=0.013
max17410.720-17410.811=-0.091
mean7600.000
σ0.000
min7600.000
max7600.000
mean2690.000-2686.000=4.000
σ0.000
min2690.000-2686.000=4.000
max2690.000-2686.000=4.000
mean26.923-26.966=-0.043
σ0.065-0.061=0.004
min26.882-26.923=-0.041
max27.020-27.053=-0.033