Compare commits

Home / Compare 25191c08 .. 8ce030dc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.974=-0.001
σ0.105-0.105=-0.000
min35.927-35.927=0.000
max36.271-36.273=-0.003
mean413.200-414.000=-0.800
σ0.422-0.000=0.422
min413.000-414.000=-1.000
max414.000
mean0.075-0.077=-0.002
σ0.004-0.003=0.001
min0.070-0.074=-0.004
max0.084-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=0.000
σ0.003-0.005=-0.002
min26.205-26.203=0.002
max26.212-26.216=-0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.061-0.061=-0.000
σ0.003-0.003=-0.000
min0.059-0.059=0.000
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.380-1758.377=0.004
σ0.369-0.369=-0.000
min1757.803-1757.799=0.004
max1758.975-1758.978=-0.003
mean1657.950-1658.600=-0.650
σ620.425-620.965=-0.540
min686.000-688.000=-2.000
max2741.000-2748.000=-7.000
mean2.389-2.382=0.007
σ0.123-0.171=-0.048
min2.273-2.082=0.190
max2.797-2.891=-0.094

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.539-279.543=-0.004
σ0.006-0.009=-0.003
min279.532-279.533=-0.000
max279.546-279.553=-0.007
mean2741.000-2748.000=-7.000
σ0.000
min2741.000-2748.000=-7.000
max2741.000-2748.000=-7.000
mean0.407-0.409=-0.002
σ0.006-0.007=-0.001
min0.403-0.404=-0.002
max0.416-0.422=-0.006
iters=5
new-facts=1
prior-facts=6402
mean2178.460-2178.478=-0.017
σ0.010-0.017=-0.006
min2178.452-2178.449=0.003
max2178.477-2178.490=-0.013
mean2741.000-2748.000=-7.000
σ0.000
min2741.000-2748.000=-7.000
max2741.000-2748.000=-7.000
mean3.316-3.398=-0.082
σ0.196-0.306=-0.110
min3.085-2.902=0.183
max3.610-3.739=-0.130
iters=5
new-facts=6402
prior-facts=1
mean5056.387-5056.283=0.103
σ0.987-1.130=-0.143
min5055.795-5055.238=0.557
max5058.142-5058.208=-0.066
mean2741.000-2748.000=-7.000
σ0.000
min2741.000-2748.000=-7.000
max2741.000-2748.000=-7.000
mean9.088-9.130=-0.042
σ0.469-0.613=-0.143
min8.281-8.205=0.076
max9.508-9.860=-0.352
iters=5
new-facts=6402
prior-facts=6402
mean5193.719-5193.789=-0.070
σ0.120-0.091=0.029
min5193.537-5193.716=-0.179
max5193.875-5193.891=-0.016
mean3284.200-3235.000=49.200
σ405.493-359.397=46.095
min2741.000-2748.000=-7.000
max3672.000-3678.000=-6.000
mean8.798-8.987=-0.190
σ0.068-0.410=-0.342
min8.708-8.651=0.057
max8.884-9.685=-0.801

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.011=-0.010
σ0.066-0.142=-0.076
min0.945-0.945=-0.001
max1.073-1.264=-0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.537-465.539=-0.002
σ572.660-572.662=-0.002
min179.201-179.200=0.001
max1324.528-1324.532=-0.004
mean79.500
σ7.000
min76.000
max90.000
mean2741.000-2748.000=-7.000
σ0.000
min2741.000-2748.000=-7.000
max2741.000-2748.000=-7.000
mean0.482-0.490=-0.008
σ0.400-0.415=-0.015
min0.279-0.280=-0.001
max1.083-1.113=-0.031
policies=20
mean1792.303-1792.304=-0.001
σ0.323-0.337=-0.014
min1792.106-1792.099=0.008
max1792.783-1792.806=-0.023
mean760.000
σ0.000
min760.000
max760.000
mean2741.000-2748.000=-7.000
σ0.000
min2741.000-2748.000=-7.000
max2741.000-2748.000=-7.000
mean2.809-2.812=-0.003
σ0.008-0.007=0.002
min2.799-2.804=-0.005
max2.818-2.820=-0.002
policies=200
mean17929.429-17929.389=0.040
σ0.457-0.459=-0.003
min17929.030-17929.048=-0.018
max17930.087-17930.060=0.026
mean7600.000
σ0.000
min7600.000
max7600.000
mean2741.000-2748.000=-7.000
σ0.000
min2741.000-2748.000=-7.000
max2741.000-2748.000=-7.000
mean28.335-28.325=0.010
σ0.069-0.142=-0.073
min28.266-28.179=0.087
max28.403-28.497=-0.094