Compare commits

Home / Compare 53e672b3 .. d05ac9d6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.047-73.044=0.004
σ0.046-0.048=-0.001
min73.021-73.019=0.002
max73.171-73.178=-0.007
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.160-0.158=0.001
σ0.005-0.005=-0.000
min0.153-0.151=0.002
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean23.740-23.741=-0.000
σ0.003-0.002=0.001
min23.736-23.739=-0.003
max23.745-23.745=-0.000
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.063-0.066=-0.002
σ0.005-0.001=0.004
min0.051-0.065=-0.013
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.785-1758.787=-0.002
σ0.362-0.361=0.001
min1758.214-1758.226=-0.012
max1759.366-1759.371=-0.005
mean1654.500-1663.900=-9.400
σ624.300-621.974=2.325
min629.000-632.000=-3.000
max2512.000-2506.000=6.000
mean2.777-2.858=-0.081
σ0.175-0.202=-0.027
min2.328-2.397=-0.070
max3.021-3.551=-0.530

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.015-324.013=0.002
σ0.050-0.061=-0.011
min323.926-323.905=0.022
max324.041-324.046=-0.005
mean2512.000-2506.000=6.000
σ0.000
min2512.000-2506.000=6.000
max2512.000-2506.000=6.000
mean0.428-0.429=-0.001
σ0.004-0.006=-0.003
min0.425-0.423=0.003
max0.434-0.436=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1984.592-1984.588=0.005
σ0.012-0.022=-0.010
min1984.573-1984.550=0.023
max1984.604-1984.606=-0.002
mean2512.000-2506.000=6.000
σ0.000
min2512.000-2506.000=6.000
max2512.000-2506.000=6.000
mean2.619-2.700=-0.081
σ0.115-0.171=-0.056
min2.493-2.566=-0.072
max2.796-2.913=-0.117
iters=5
new-facts=6402
prior-facts=1
mean4808.226-4808.171=0.055
σ7.777-7.548=0.229
min4804.671-4804.666=0.005
max4822.137-4821.671=0.466
mean2512.000-2506.000=6.000
σ0.000
min2512.000-2506.000=6.000
max2512.000-2506.000=6.000
mean8.753-8.754=-0.000
σ0.176-0.517=-0.341
min8.595-7.972=0.622
max9.026-9.204=-0.179
iters=5
new-facts=6402
prior-facts=6402
mean4995.597-4995.802=-0.206
σ0.300-0.021=0.279
min4995.120-4995.773=-0.653
max4995.816-4995.824=-0.008
mean2996.400-2958.000=38.400
σ277.983-271.453=6.530
min2608.000-2593.000=15.000
max3297.000-3315.000=-18.000
mean8.792-8.574=0.217
σ0.149-0.142=0.007
min8.568-8.399=0.169
max8.942-8.778=0.164

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.627-1.673=-0.046
σ0.237-0.174=0.063
min1.235-1.372=-0.137
max1.816-1.803=0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.329-468.326=0.003
σ574.231-574.232=-0.002
min181.210-181.208=0.002
max1329.675-1329.675=-0.000
mean88.250
σ8.500
min84.000
max101.000
mean2512.000-2506.000=6.000
σ0.000
min2512.000-2506.000=6.000
max2512.000-2506.000=6.000
mean0.572-0.548=0.024
σ0.576-0.531=0.044
min0.283-0.280=0.004
max1.436-1.345=0.090
policies=20
mean1812.427-1812.428=-0.001
σ0.394-0.388=0.006
min1812.149-1812.171=-0.022
max1813.007-1813.003=0.004
mean840.000
σ0.000
min840.000
max840.000
mean2512.000-2506.000=6.000
σ0.000
min2512.000-2506.000=6.000
max2512.000-2506.000=6.000
mean2.827-2.813=0.014
σ0.029-0.008=0.021
min2.796-2.803=-0.007
max2.862-2.820=0.042
policies=200
mean18131.466-18131.622=-0.156
σ0.473-0.446=0.027
min18131.151-18131.317=-0.166
max18132.153-18132.281=-0.129
mean8400.000
σ0.000
min8400.000
max8400.000
mean2512.000-2506.000=6.000
σ0.000
min2512.000-2506.000=6.000
max2512.000-2506.000=6.000
mean28.332-28.291=0.040
σ0.085-0.084=0.001
min28.228-28.207=0.022
max28.407-28.399=0.008