Compare commits

Home / Compare 0f4eb36a .. b743f6ae

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-35.966=-0.000
σ0.102-0.103=-0.001
min35.926-35.922=0.004
max36.255-36.257=-0.002
mean413.900-412.000=1.900
σ0.316-0.000=0.316
min413.000-412.000=1.000
max414.000-412.000=2.000
mean0.075-0.077=-0.002
σ0.004-0.004=-0.000
min0.070-0.074=-0.004
max0.083-0.084=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.209-26.209=-0.000
σ0.006-0.004=0.001
min26.201-26.203=-0.002
max26.219-26.217=0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.061-0.060=0.001
σ0.002-0.003=-0.000
min0.058-0.058=-0.000
max0.067-0.067=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.761-1756.315=1.445
σ0.369-0.367=0.003
min1757.180-1755.740=1.440
max1758.355-1756.909=1.445
mean1663.750-1657.000=6.750
σ621.341-639.392=-18.050
min661.000-609.000=52.000
max2610.000-2696.000=-86.000
mean2.352-2.376=-0.024
σ0.116-0.177=-0.061
min2.197-2.249=-0.052
max2.622-3.054=-0.432

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean280.290-278.840=1.451
σ0.012-0.014=-0.002
min280.275-278.819=1.456
max280.303-278.851=1.452
mean2610.000-2696.000=-86.000
σ0.000
min2610.000-2696.000=-86.000
max2610.000-2696.000=-86.000
mean0.414-0.415=-0.000
σ0.007-0.005=0.002
min0.406-0.409=-0.003
max0.422-0.419=0.003
iters=5
new-facts=1
prior-facts=6402
mean2270.305-2268.907=1.398
σ0.016-0.010=0.006
min2270.279-2268.895=1.384
max2270.319-2268.918=1.401
mean2610.000-2696.000=-86.000
σ0.000
min2610.000-2696.000=-86.000
max2610.000-2696.000=-86.000
mean3.123-3.013=0.110
σ0.157-0.190=-0.032
min2.915-2.877=0.038
max3.340-3.319=0.021
iters=5
new-facts=6402
prior-facts=1
mean5147.587-4954.265=193.322
σ1.015-0.872=0.143
min5146.982-4953.854=193.129
max5149.392-4955.824=193.568
mean2610.000-2696.000=-86.000
σ0.000
min2610.000-2696.000=-86.000
max2610.000-2696.000=-86.000
mean8.921-8.082=0.839
σ0.703-0.424=0.279
min8.144-7.688=0.456
max9.907-8.711=1.196
iters=5
new-facts=6402
prior-facts=6402
mean5285.634-5168.743=116.891
σ0.083-0.203=-0.121
min5285.562-5168.400=117.162
max5285.727-5168.907=116.820
mean3493.000-3452.600=40.400
σ534.992-472.128=62.864
min2780.000-2861.000=-81.000
max4002.000-4131.000=-129.000
mean9.814-9.280=0.534
σ0.500-0.224=0.276
min8.955-9.022=-0.066
max10.257-9.588=0.669

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.245-1.157=0.088
σ0.391-0.390=0.001
min0.934-0.948=-0.014
max1.836-1.850=-0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.304-460.361=3.943
σ572.672-572.651=0.021
min177.964-174.029=3.934
max1323.312-1319.338=3.974
mean81.500-79.500=2.000
σ7.000
min78.000-76.000=2.000
max92.000-90.000=2.000
mean2610.000-2696.000=-86.000
σ0.000
min2610.000-2696.000=-86.000
max2610.000-2696.000=-86.000
mean0.558-0.546=0.012
σ0.558-0.537=0.021
min0.273-0.272=0.002
max1.395-1.352=0.043
policies=20
mean1779.886-1740.497=39.389
σ0.372-0.317=0.055
min1779.662-1740.292=39.370
max1780.442-1740.970=39.472
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2610.000-2696.000=-86.000
σ0.000
min2610.000-2696.000=-86.000
max2610.000-2696.000=-86.000
mean2.796-2.685=0.111
σ0.042-0.012=0.029
min2.767-2.678=0.089
max2.858-2.703=0.155
policies=200
mean17805.839-17411.932=393.907
σ0.461-0.516=-0.055
min17805.479-17411.621=393.858
max17806.515-17412.703=393.812
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2610.000-2696.000=-86.000
σ0.000
min2610.000-2696.000=-86.000
max2610.000-2696.000=-86.000
mean27.840-27.020=0.820
σ0.097-0.088=0.009
min27.713-26.918=0.795
max27.933-27.098=0.835