Compare commits

Home / Compare d04f36f7 .. 0c75c412

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.711-53.704=0.007
σ0.364-0.365=-0.001
min53.582-53.566=0.016
max54.746-54.742=0.004
mean413.600-415.000=-1.400
σ0.516-0.000=0.516
min413.000-415.000=-2.000
max414.000-415.000=-1.000
mean0.140-0.136=0.004
σ0.004-0.005=-0.001
min0.136-0.127=0.009
max0.146-0.142=0.004
cache=y
dps=1
iters=10
policies=100
mean42.979-42.977=0.001
σ0.006-0.005=0.001
min42.970-42.971=-0.001
max42.989-42.988=0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.119-0.118=0.001
σ0.005-0.004=0.000
min0.114-0.113=0.001
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.219-994.902=0.317
σ1.195-1.202=-0.007
min994.686-994.363=0.323
max1000.227-999.946=0.282
mean1066.350-1061.350=5.000
σ315.371-323.131=-7.761
min603.000-561.000=42.000
max1612.000-1625.000=-13.000
mean1.485-1.454=0.031
σ0.075-0.078=-0.003
min1.375-1.390=-0.015
max1.662-1.651=0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.316-297.314=0.002
σ0.006-0.008=-0.003
min297.308-297.307=0.001
max297.323-297.328=-0.005
mean1612.000-1625.000=-13.000
σ0.000
min1612.000-1625.000=-13.000
max1612.000-1625.000=-13.000
mean0.386-0.394=-0.008
σ0.001-0.007=-0.006
min0.385-0.387=-0.002
max0.387-0.402=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1298.985-1298.661=0.324
σ0.084-0.025=0.060
min1298.837-1298.625=0.211
max1299.048-1298.690=0.358
mean1612.000-1625.000=-13.000
σ0.000
min1612.000-1625.000=-13.000
max1612.000-1625.000=-13.000
mean1.941-1.883=0.058
σ0.058-0.050=0.008
min1.863-1.833=0.030
max2.017-1.964=0.053
iters=5
new-facts=6402
prior-facts=1
mean1719.180-1718.875=0.304
σ6.879-6.934=-0.055
min1715.995-1715.648=0.347
max1731.482-1731.275=0.207
mean1612.000-1625.000=-13.000
σ0.000
min1612.000-1625.000=-13.000
max1612.000-1625.000=-13.000
mean2.911-2.959=-0.048
σ0.263-0.443=-0.180
min2.604-2.533=0.071
max3.271-3.687=-0.416
iters=5
new-facts=6402
prior-facts=6402
mean1981.931-1981.621=0.310
σ0.025-0.016=0.008
min1981.887-1981.602=0.286
max1981.945-1981.640=0.306
mean1820.600-1880.600=-60.000
σ154.975-194.444=-39.468
min1612.000-1625.000=-13.000
max1957.000-2087.000=-130.000
mean3.143-3.258=-0.115
σ0.129-0.093=0.036
min2.941-3.143=-0.202
max3.253-3.345=-0.092

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.213-1.198=0.015
σ0.275-0.277=-0.002
min0.917-0.916=0.001
max1.622-1.648=-0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.460-440.371=0.089
σ573.035-572.883=0.152
min153.937-153.927=0.010
max1300.012-1299.696=0.317
mean94.250
σ8.500
min90.000
max107.000
mean1612.000-1625.000=-13.000
σ0.000
min1612.000-1625.000=-13.000
max1612.000-1625.000=-13.000
mean0.548-0.542=0.006
σ0.557-0.573=-0.015
min0.265-0.254=0.010
max1.384-1.401=-0.017
policies=20
mean1539.576-1539.512=0.064
σ0.301-0.298=0.003
min1539.385-1539.325=0.060
max1540.025-1539.956=0.068
mean900.000
σ0.000
min900.000
max900.000
mean1612.000-1625.000=-13.000
σ0.000
min1612.000-1625.000=-13.000
max1612.000-1625.000=-13.000
mean2.568-2.558=0.011
σ0.031-0.010=0.021
min2.537-2.548=-0.010
max2.612-2.569=0.043
policies=200
mean15403.726-15403.078=0.648
σ0.092-0.057=0.035
min15403.606-15403.026=0.581
max15403.804-15403.159=0.646
mean9000.000
σ0.000
min9000.000
max9000.000
mean1612.000-1625.000=-13.000
σ0.000
min1612.000-1625.000=-13.000
max1612.000-1625.000=-13.000
mean25.912-25.983=-0.071
σ0.174-0.211=-0.037
min25.745-25.817=-0.073
max26.106-26.259=-0.153