Compare commits

Home / Compare 3b623df5 .. f06581e4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.710-53.710=0.001
σ0.364-0.364=-0.000
min53.576-53.574=0.001
max54.744-54.744=-0.000
mean414.000-413.800=0.200
σ0.000-0.422=-0.422
min414.000-413.000=1.000
max414.000
mean0.137-0.143=-0.006
σ0.003-0.009=-0.005
min0.133-0.136=-0.003
max0.145-0.160=-0.015
cache=y
dps=1
iters=10
policies=100
mean42.978-42.978=-0.000
σ0.007-0.006=0.001
min42.968-42.965=0.003
max42.990-42.987=0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.119-0.121=-0.002
σ0.004-0.003=0.001
min0.113-0.118=-0.005
max0.125-0.127=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.223-995.222=0.001
σ1.188-1.197=-0.009
min994.667-994.683=-0.017
max1000.202-1000.245=-0.043
mean1057.700-1054.800=2.900
σ311.630-307.343=4.287
min608.000-595.000=13.000
max1626.000-1554.000=72.000
mean1.477-1.470=0.007
σ0.078-0.071=0.007
min1.381-1.383=-0.002
max1.649-1.651=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.301-297.320=-0.018
σ0.020-0.004=0.016
min297.280-297.315=-0.035
max297.321-297.325=-0.004
mean1626.000-1554.000=72.000
σ0.000
min1626.000-1554.000=72.000
max1626.000-1554.000=72.000
mean0.391-0.391=-0.000
σ0.006-0.006=0.000
min0.386-0.386=0.000
max0.400-0.399=0.001
iters=5
new-facts=1
prior-facts=6402
mean1299.009-1299.026=-0.018
σ0.036-0.059=-0.023
min1298.957-1298.932=0.025
max1299.051-1299.070=-0.019
mean1626.000-1554.000=72.000
σ0.000
min1626.000-1554.000=72.000
max1626.000-1554.000=72.000
mean1.969-1.873=0.095
σ0.161-0.039=0.122
min1.830-1.822=0.009
max2.206-1.927=0.278
iters=5
new-facts=6402
prior-facts=1
mean1719.173-1719.184=-0.011
σ6.907-6.943=-0.036
min1715.983-1715.918=0.065
max1731.524-1731.599=-0.075
mean1626.000-1554.000=72.000
σ0.000
min1626.000-1554.000=72.000
max1626.000-1554.000=72.000
mean2.918-3.010=-0.092
σ0.324-0.466=-0.142
min2.515-2.533=-0.018
max3.391-3.737=-0.346
iters=5
new-facts=6402
prior-facts=6402
mean1981.950-1981.935=0.014
σ0.023-0.015=0.008
min1981.914-1981.922=-0.008
max1981.971-1981.960=0.011
mean1893.200-1827.400=65.800
σ224.930-195.147=29.784
min1626.000-1569.000=57.000
max2173.000-2071.000=102.000
mean3.213-3.215=-0.002
σ0.072-0.120=-0.048
min3.123-3.063=0.060
max3.293-3.360=-0.067

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.260-1.481=-0.221
σ0.338-0.335=0.003
min0.904-1.027=-0.123
max1.778-1.801=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.465-440.449=0.016
σ573.039-573.028=0.011
min153.933-153.930=0.003
max1300.023-1299.991=0.032
mean94.250
σ8.500
min90.000
max107.000
mean1626.000-1554.000=72.000
σ0.000
min1626.000-1554.000=72.000
max1626.000-1554.000=72.000
mean0.551-0.534=0.017
σ0.585-0.553=0.032
min0.257-0.254=0.003
max1.428-1.363=0.065
policies=20
mean1539.611-1539.580=0.031
σ0.304-0.266=0.038
min1539.410-1539.399=0.011
max1540.063-1539.974=0.089
mean900.000
σ0.000
min900.000
max900.000
mean1626.000-1554.000=72.000
σ0.000
min1626.000-1554.000=72.000
max1626.000-1554.000=72.000
mean2.565-2.556=0.009
σ0.022-0.002=0.020
min2.542-2.554=-0.012
max2.596-2.558=0.037
policies=200
mean15404.019-15404.123=-0.104
σ0.120-0.082=0.038
min15403.891-15404.003=-0.112
max15404.178-15404.185=-0.007
mean9000.000
σ0.000
min9000.000
max9000.000
mean1626.000-1554.000=72.000
σ0.000
min1626.000-1554.000=72.000
max1626.000-1554.000=72.000
mean25.863-25.890=-0.027
σ0.160-0.127=0.034
min25.648-25.760=-0.112
max26.028-26.016=0.012