Compare commits

Home / Compare a9a45840 .. dc061d26

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727-36.721=0.005
σ0.612-0.875=-0.263
min35.934-35.927=0.007
max37.203-38.602=-1.399
mean3954.000-3786.000=168.000
σ0.000
min3954.000-3786.000=168.000
max3954.000-3786.000=168.000
mean0.077-0.076=0.001
σ0.003-0.002=0.001
min0.075-0.074=0.001
max0.083-0.081=0.002
cache=y
dps=1
iters=10
policies=100
mean26.710-26.711=-0.000
σ0.645-0.647=-0.002
min26.202-26.204=-0.002
max27.462-27.466=-0.004
mean3954.000-3786.000=168.000
σ0.000
min3954.000-3786.000=168.000
max3954.000-3786.000=168.000
mean0.060-0.059=0.001
σ0.000-0.003=-0.002
min0.059-0.057=0.002
max0.061-0.064=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.360-1756.360=0.000
σ0.374-0.374=-0.000
min1755.791-1755.785=0.006
max1756.957-1756.960=-0.002
mean1654.600-1655.500=-0.900
σ629.031-627.374=1.657
min615.000-612.000=3.000
max2655.000-2648.000=7.000
mean2.318-2.352=-0.034
σ0.157-0.217=-0.061
min2.165-2.185=-0.020
max2.825-2.823=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.671-278.677=-0.006
σ0.009-0.011=-0.002
min278.657-278.666=-0.010
max278.679-278.695=-0.015
mean2655.000-2648.000=7.000
σ0.000
min2655.000-2648.000=7.000
max2655.000-2648.000=7.000
mean0.419-0.421=-0.002
σ0.001-0.009=-0.008
min0.417-0.416=0.001
max0.420-0.438=-0.017
iters=5
new-facts=1
prior-facts=6402
mean2268.844-2268.833=0.011
σ0.004-0.015=-0.011
min2268.839-2268.817=0.022
max2268.848-2268.846=0.003
mean2655.000-2648.000=7.000
σ0.000
min2655.000-2648.000=7.000
max2655.000-2648.000=7.000
mean2.988-3.152=-0.164
σ0.113-0.164=-0.051
min2.897-2.938=-0.041
max3.184-3.336=-0.151
iters=5
new-facts=6402
prior-facts=1
mean4952.192-4952.000=0.192
σ0.594-1.091=-0.498
min4951.799-4950.831=0.968
max4953.242-4953.753=-0.511
mean2655.000-2648.000=7.000
σ0.000
min2655.000-2648.000=7.000
max2655.000-2648.000=7.000
mean8.153-7.916=0.237
σ0.400-0.032=0.369
min7.785-7.883=-0.098
max8.756-7.956=0.800
iters=5
new-facts=6402
prior-facts=6402
mean5166.971-5167.047=-0.076
σ0.162-0.012=0.150
min5166.682-5167.038=-0.356
max5167.047-5167.067=-0.020
mean3352.800-3355.600=-2.800
σ450.028-424.705=25.323
min2769.000-2937.000=-168.000
max3954.000-3786.000=168.000
mean9.537-9.348=0.189
σ0.275-0.275=0.001
min9.094-9.102=-0.009
max9.755-9.715=0.040

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.056-1.635=-0.580
σ0.118-0.267=-0.149
min0.939-1.209=-0.270
max1.227-1.903=-0.676

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.250-460.253=-0.004
σ572.606-572.607=-0.001
min173.944-173.948=-0.005
max1319.159-1319.165=-0.005
mean79.500
σ7.000
min76.000
max90.000
mean436.000
σ0.000
min436.000
max436.000
mean0.569-0.573=-0.004
σ0.583-0.590=-0.007
min0.273-0.275=-0.002
max1.443-1.458=-0.015
policies=20
mean1739.980-1739.992=-0.012
σ0.339-0.336=0.003
min1739.728-1739.751=-0.022
max1740.475-1740.485=-0.011
mean760.000
σ0.000
min760.000
max760.000
mean446.000-446.250=-0.250
σ9.381-10.178=-0.797
min436.000
max454.000-455.000=-1.000
mean2.687-2.669=0.018
σ0.018-0.009=0.009
min2.665-2.657=0.008
max2.707-2.677=0.031
policies=200
mean17409.099-17409.072=0.028
σ0.143-0.071=0.072
min17408.900-17408.994=-0.094
max17409.231-17409.164=0.067
mean7600.000
σ0.000
min7600.000
max7600.000
mean489.250-490.750=-1.500
σ1.258-1.708=-0.450
min488.000-489.000=-1.000
max491.000-493.000=-2.000
mean26.963-26.968=-0.005
σ0.072-0.118=-0.045
min26.903-26.821=0.082
max27.066-27.079=-0.013