Compare commits

Home / Compare 1b79ee92 .. 5c31e563

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.048-0.047=0.001
min33.948-33.950=-0.002
max34.111-34.109=0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.084-0.084=-0.000
σ0.004-0.003=0.000
min0.082-0.082=0.000
max0.091-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.000
σ0.003-0.003=-0.000
min23.314-23.312=0.002
max23.323-23.321=0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.065-0.066=-0.000
σ0.002-0.004=-0.002
min0.064-0.060=0.003
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.430-1757.431=-0.001
σ0.365-0.365=0.000
min1756.857-1756.855=0.002
max1758.018-1758.023=-0.005
mean1648.000-1645.050=2.950
σ625.368-625.743=-0.376
min637.000-634.000=3.000
max2837.000-2831.000=6.000
mean2.375-2.367=0.008
σ0.077-0.101=-0.023
min2.267-2.254=0.012
max2.569-2.688=-0.119

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.571-326.575=-0.004
σ0.048-0.054=-0.006
min326.486-326.479=0.007
max326.608-326.614=-0.006
mean2837.000-2831.000=6.000
σ0.000
min2837.000-2831.000=6.000
max2837.000-2831.000=6.000
mean0.417-0.426=-0.009
σ0.018-0.006=0.012
min0.385-0.422=-0.036
max0.427-0.435=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1988.738-1988.741=-0.003
σ0.011-0.009=0.002
min1988.723-1988.726=-0.003
max1988.748-1988.749=-0.000
mean2837.000-2831.000=6.000
σ0.000
min2837.000-2831.000=6.000
max2837.000-2831.000=6.000
mean2.688-2.699=-0.011
σ0.233-0.078=0.156
min2.445-2.598=-0.153
max3.071-2.781=0.290
iters=5
new-facts=6402
prior-facts=1
mean4813.602-4813.600=0.003
σ7.747-7.752=-0.006
min4810.039-4810.074=-0.035
max4827.460-4827.467=-0.008
mean2837.000-2831.000=6.000
σ0.000
min2837.000-2831.000=6.000
max2837.000-2831.000=6.000
mean8.481-9.013=-0.532
σ0.590-0.334=0.256
min7.831-8.660=-0.829
max9.313-9.354=-0.041
iters=5
new-facts=6402
prior-facts=6402
mean5001.138-5001.078=0.060
σ0.019-0.175=-0.156
min5001.120-5000.770=0.350
max5001.167-5001.202=-0.034
mean3065.800-3028.200=37.600
σ309.824-204.760=105.064
min2837.000-2831.000=6.000
max3547.000-3319.000=228.000
mean9.541-9.975=-0.434
σ0.616-0.232=0.384
min8.503-9.726=-1.222
max10.087-10.333=-0.245

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.971-0.944=0.027
σ0.064-0.056=0.008
min0.911-0.909=0.002
max1.041-1.043=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.573-464.566=0.007
σ574.772-574.773=-0.002
min177.176-177.176=0.000
max1326.731-1326.726=0.005
mean88.250
σ8.500
min84.000
max101.000
mean2837.000-2831.000=6.000
σ0.000
min2837.000-2831.000=6.000
max2837.000-2831.000=6.000
mean0.432-0.433=-0.001
σ0.305-0.307=-0.002
min0.278-0.277=0.000
max0.889-0.894=-0.004
policies=20
mean1772.043-1772.075=-0.032
σ0.348-0.365=-0.017
min1771.827-1771.825=0.002
max1772.559-1772.616=-0.057
mean840.000
σ0.000
min840.000
max840.000
mean2837.000-2831.000=6.000
σ0.000
min2837.000-2831.000=6.000
max2837.000-2831.000=6.000
mean2.815-2.796=0.019
σ0.021-0.002=0.019
min2.792-2.795=-0.002
max2.837-2.799=0.038
policies=200
mean17727.575-17727.647=-0.073
σ0.525-0.490=0.035
min17727.216-17727.241=-0.025
max17728.345-17728.355=-0.011
mean8400.000
σ0.000
min8400.000
max8400.000
mean2837.000-2831.000=6.000
σ0.000
min2837.000-2831.000=6.000
max2837.000-2831.000=6.000
mean28.014-27.861=0.153
σ0.403-0.378=0.025
min27.638-27.507=0.131
max28.430-28.237=0.193