Compare commits

Home / Compare 33c937d8 .. 9a7f630c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.709-53.709=-0.000
σ0.364-0.364=-0.001
min53.576-53.567=0.009
max54.743-54.745=-0.002
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.138-0.139=-0.001
σ0.003-0.004=-0.001
min0.135-0.135=-0.000
max0.144-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.980-42.979=0.001
σ0.006-0.005=0.001
min42.971-42.969=0.002
max42.990-42.986=0.003
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.121-0.121=-0.000
σ0.003-0.004=-0.000
min0.118-0.118=-0.000
max0.127-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.220-995.225=-0.005
σ1.198-1.172=0.026
min994.666-994.693=-0.027
max1000.249-1000.138=0.111
mean1067.900-1055.600=12.300
σ311.799-311.236=0.563
min600.000-593.000=7.000
max1637.000-1511.000=126.000
mean1.463-1.504=-0.041
σ0.053-0.138=-0.085
min1.391-1.393=-0.002
max1.584-2.006=-0.422

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.320-297.320=0.000
σ0.004-0.008=-0.004
min297.316-297.308=0.008
max297.325-297.329=-0.004
mean1637.000-1511.000=126.000
σ0.000
min1637.000-1511.000=126.000
max1637.000-1511.000=126.000
mean0.391-0.391=-0.000
σ0.005-0.006=-0.001
min0.387-0.386=0.001
max0.398-0.400=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1299.013-1299.000=0.013
σ0.067-0.098=-0.031
min1298.898-1298.837=0.061
max1299.063-1299.062=0.001
mean1637.000-1511.000=126.000
σ0.000
min1637.000-1511.000=126.000
max1637.000-1511.000=126.000
mean1.880-1.905=-0.025
σ0.028-0.139=-0.111
min1.839-1.810=0.029
max1.906-2.151=-0.245
iters=5
new-facts=6402
prior-facts=1
mean1719.178-1719.171=0.008
σ6.918-6.913=0.005
min1715.915-1715.945=-0.030
max1731.548-1731.532=0.016
mean1637.000-1511.000=126.000
σ0.000
min1637.000-1511.000=126.000
max1637.000-1511.000=126.000
mean3.073-3.322=-0.249
σ0.399-0.280=0.120
min2.575-3.027=-0.453
max3.557-3.638=-0.081
iters=5
new-facts=6402
prior-facts=6402
mean1981.943-1981.934=0.010
σ0.028-0.037=-0.010
min1981.925-1981.870=0.055
max1981.990-1981.968=0.022
mean1808.400-1796.400=12.000
σ160.349-234.334=-73.985
min1637.000-1532.000=105.000
max2031.000-2127.000=-96.000
mean3.267-3.295=-0.028
σ0.182-0.377=-0.195
min3.090-3.040=0.050
max3.570-3.961=-0.391

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.191-1.547=-0.356
σ0.228-0.247=-0.019
min0.922-1.240=-0.318
max1.522-1.806=-0.284

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.466-440.448=0.018
σ573.038-573.026=0.011
min153.937-153.930=0.007
max1300.022-1299.988=0.034
mean94.250
σ8.500
min90.000
max107.000
mean1637.000-1511.000=126.000
σ0.000
min1637.000-1511.000=126.000
max1637.000-1511.000=126.000
mean0.553-0.556=-0.003
σ0.606-0.575=0.031
min0.244-0.267=-0.022
max1.462-1.418=0.044
policies=20
mean1539.610-1539.592=0.018
σ0.298-0.313=-0.016
min1539.424-1539.388=0.036
max1540.053-1540.057=-0.004
mean900.000
σ0.000
min900.000
max900.000
mean1637.000-1511.000=126.000
σ0.000
min1637.000-1511.000=126.000
max1637.000-1511.000=126.000
mean2.565-2.577=-0.012
σ0.016-0.015=0.001
min2.542-2.563=-0.021
max2.579-2.590=-0.011
policies=200
mean15404.121-15404.049=0.072
σ0.047-0.111=-0.064
min15404.061-15403.924=0.137
max15404.161-15404.157=0.004
mean9000.000
σ0.000
min9000.000
max9000.000
mean1637.000-1511.000=126.000
σ0.000
min1637.000-1511.000=126.000
max1637.000-1511.000=126.000
mean25.993-26.085=-0.091
σ0.119-0.169=-0.050
min25.847-25.903=-0.056
max26.113-26.238=-0.125