Compare commits

Home / Compare f4459c21 .. 754e8f45

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.048-70.708=2.340
σ0.049-0.045=0.004
min73.024-70.680=2.344
max73.187-70.834=2.352
mean419.100-414.800=4.300
σ0.568-0.422=0.146
min418.000-414.000=4.000
max420.000-415.000=5.000
mean0.162-0.164=-0.002
σ0.003-0.006=-0.003
min0.158-0.157=0.001
max0.167-0.177=-0.010
cache=y
dps=1
iters=10
policies=100
mean23.741-21.412=2.330
σ0.004-0.002=0.002
min23.737-21.407=2.329
max23.751-21.415=2.337
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.066-0.065=0.001
σ0.002-0.003=-0.001
min0.064-0.063=0.001
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1754.930=3.858
σ0.360-0.361=-0.001
min1758.213-1754.363=3.849
max1759.368-1755.515=3.853
mean1662.950-1666.700=-3.750
σ626.600-620.222=6.379
min629.000-626.000=3.000
max2521.000-2503.000=18.000
mean2.826-2.804=0.022
σ0.101-0.172=-0.071
min2.603-2.269=0.334
max2.953-3.003=-0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.013-272.791=51.222
σ0.055-0.006=0.048
min323.916-272.785=51.131
max324.043-272.799=51.244
mean2521.000-2503.000=18.000
σ0.000
min2521.000-2503.000=18.000
max2521.000-2503.000=18.000
mean0.428-0.376=0.052
σ0.005-0.001=0.004
min0.425-0.375=0.050
max0.437-0.378=0.060
iters=5
new-facts=1
prior-facts=6402
mean1984.592-1933.222=51.370
σ0.022-0.010=0.012
min1984.555-1933.212=51.344
max1984.607-1933.238=51.370
mean2521.000-2503.000=18.000
σ0.000
min2521.000-2503.000=18.000
max2521.000-2503.000=18.000
mean2.613-2.989=-0.376
σ0.104-0.142=-0.037
min2.491-2.755=-0.265
max2.744-3.102=-0.358
iters=5
new-facts=6402
prior-facts=1
mean4808.226-4756.816=51.410
σ7.815-7.610=0.205
min4804.651-4752.878=51.772
max4822.205-4770.417=51.789
mean2521.000-2503.000=18.000
σ0.000
min2521.000-2503.000=18.000
max2521.000-2503.000=18.000
mean8.857-8.674=0.183
σ0.136-0.378=-0.242
min8.646-8.163=0.483
max9.026-9.073=-0.047
iters=5
new-facts=6402
prior-facts=6402
mean4995.666-4944.447=51.219
σ0.181-0.012=0.169
min4995.467-4944.433=51.034
max4995.825-4944.465=51.360
mean2992.600-2971.200=21.400
σ300.319-271.021=29.298
min2584.000-2623.000=-39.000
max3362.000-3332.000=30.000
mean8.685-8.537=0.147
σ0.147-0.087=0.059
min8.543-8.443=0.100
max8.928-8.669=0.259

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.570-1.553=0.017
σ0.193-0.221=-0.028
min1.243-1.183=0.059
max1.712-1.777=-0.064

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.328-468.305=0.023
σ574.236-574.231=0.005
min181.209-181.183=0.026
max1329.682-1329.652=0.030
mean88.250
σ8.500
min84.000
max101.000
mean2521.000-2503.000=18.000
σ0.000
min2521.000-2503.000=18.000
max2521.000-2503.000=18.000
mean0.554-0.565=-0.011
σ0.540-0.558=-0.018
min0.283-0.286=-0.003
max1.364-1.401=-0.037
policies=20
mean1812.422-1812.152=0.269
σ0.386-0.395=-0.009
min1812.152-1811.881=0.271
max1812.991-1812.736=0.256
mean840.000
σ0.000
min840.000
max840.000
mean2521.000-2503.000=18.000
σ0.000
min2521.000-2503.000=18.000
max2521.000-2503.000=18.000
mean2.821-2.813=0.008
σ0.005-0.016=-0.011
min2.817-2.793=0.024
max2.825-2.829=-0.004
policies=200
mean18131.469-18129.034=2.435
σ0.618-0.541=0.077
min18131.021-18128.590=2.431
max18132.374-18129.804=2.570
mean8400.000
σ0.000
min8400.000
max8400.000
mean2521.000-2503.000=18.000
σ0.000
min2521.000-2503.000=18.000
max2521.000-2503.000=18.000
mean28.406-28.330=0.076
σ0.114-0.046=0.068
min28.337-28.282=0.055
max28.575-28.387=0.188