Compare commits

Home / Compare 40a1c8c5 .. a2854df8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.981-33.978=0.003
σ0.049-0.050=-0.000
min33.952-33.951=0.001
max34.117-34.117=0.001
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.087-0.082=0.005
σ0.004-0.005=-0.001
min0.084-0.077=0.007
max0.095-0.090=0.005
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.002-0.003=-0.001
min23.315-23.312=0.003
max23.322-23.322=-0.000
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.066-0.065=0.001
σ0.002-0.004=-0.001
min0.064-0.060=0.004
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.492-1757.494=-0.002
σ0.365-0.364=0.001
min1756.921-1756.922=-0.001
max1758.084-1758.083=0.001
mean1647.600-1666.000=-18.400
σ633.346-641.590=-8.244
min632.000-673.000=-41.000
max2855.000-2639.000=216.000
mean2.393-2.413=-0.021
σ0.099-0.118=-0.018
min2.256-2.290=-0.034
max2.639-2.738=-0.099

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.637-326.633=0.003
σ0.049-0.050=-0.001
min326.553-326.546=0.007
max326.675-326.673=0.002
mean2855.000-2639.000=216.000
σ0.000
min2855.000-2639.000=216.000
max2855.000-2639.000=216.000
mean0.430-0.424=0.006
σ0.005-0.002=0.004
min0.425-0.422=0.003
max0.437-0.425=0.011
iters=5
new-facts=1
prior-facts=6402
mean1988.793-1988.809=-0.015
σ0.024-0.003=0.021
min1988.773-1988.803=-0.030
max1988.820-1988.811=0.009
mean2855.000-2639.000=216.000
σ0.000
min2855.000-2639.000=216.000
max2855.000-2639.000=216.000
mean2.712-2.672=0.040
σ0.169-0.056=0.113
min2.584-2.615=-0.031
max3.003-2.756=0.247
iters=5
new-facts=6402
prior-facts=1
mean4813.554-4813.572=-0.018
σ7.825-7.756=0.069
min4809.707-4809.828=-0.121
max4827.546-4827.442=0.104
mean2855.000-2639.000=216.000
σ0.000
min2855.000-2639.000=216.000
max2855.000-2639.000=216.000
mean8.934-8.705=0.230
σ0.532-0.658=-0.126
min8.168-7.736=0.432
max9.503-9.303=0.200
iters=5
new-facts=6402
prior-facts=6402
mean5001.130-5001.068=0.062
σ0.163-0.206=-0.043
min5000.841-5000.828=0.013
max5001.235-5001.268=-0.033
mean3015.200-3016.000=-0.800
σ183.130-285.606=-102.476
min2855.000-2639.000=216.000
max3302.000-3388.000=-86.000
mean9.604-9.848=-0.244
σ0.555-0.268=0.288
min8.755-9.481=-0.726
max10.264-10.219=0.045

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.043-1.139=-0.097
σ0.129-0.242=-0.113
min0.923-0.939=-0.016
max1.238-1.550=-0.312

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.638-464.632=0.006
σ574.770-574.779=-0.009
min177.243-177.240=0.002
max1326.794-1326.801=-0.008
mean88.250
σ8.500
min84.000
max101.000
mean2855.000-2639.000=216.000
σ0.000
min2855.000-2639.000=216.000
max2855.000-2639.000=216.000
mean0.437-0.556=-0.118
σ0.310-0.576=-0.266
min0.279-0.254=0.025
max0.902-1.419=-0.517
policies=20
mean1772.715-1772.680=0.035
σ0.366-0.348=0.018
min1772.464-1772.445=0.020
max1773.258-1773.197=0.061
mean840.000
σ0.000
min840.000
max840.000
mean2855.000-2639.000=216.000
σ0.000
min2855.000-2639.000=216.000
max2855.000-2639.000=216.000
mean2.791-2.703=0.087
σ0.013-0.011=0.003
min2.777-2.689=0.088
max2.808-2.713=0.095
policies=200
mean17733.970-17734.082=-0.112
σ0.493-0.529=-0.036
min17733.512-17733.750=-0.238
max17734.663-17734.870=-0.207
mean8400.000
σ0.000
min8400.000
max8400.000
mean2855.000-2639.000=216.000
σ0.000
min2855.000-2639.000=216.000
max2855.000-2639.000=216.000
mean27.921-27.583=0.337
σ0.507-0.137=0.370
min27.306-27.401=-0.095
max28.501-27.725=0.776