Compare commits

Home / Compare 05a708cc .. d0cfc4d5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.779-70.778=0.001
σ0.052-0.052=0.001
min70.743-70.747=-0.003
max70.924-70.922=0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.159-0.158=0.001
σ0.003-0.006=-0.003
min0.156-0.149=0.007
max0.164-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.494-21.493=0.001
σ0.003-0.003=0.000
min21.489-21.488=0.001
max21.497-21.497=0.000
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.065-0.063=0.003
σ0.003-0.004=-0.001
min0.064-0.059=0.004
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.879-1751.880=-0.001
σ0.361-0.361=0.000
min1751.306-1751.310=-0.004
max1752.455-1752.464=-0.009
mean1649.200-1663.200=-14.000
σ623.919-638.915=-14.997
min672.000-674.000=-2.000
max2695.000-2694.000=1.000
mean2.813-2.806=0.006
σ0.220-0.186=0.034
min2.258-2.237=0.021
max3.249-3.011=0.237

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.362-269.347=0.015
σ0.013-0.005=0.009
min269.346-269.340=0.006
max269.376-269.353=0.023
mean2695.000-2694.000=1.000
σ0.000
min2695.000-2694.000=1.000
max2695.000-2694.000=1.000
mean0.378-0.380=-0.002
σ0.005-0.006=-0.001
min0.374-0.376=-0.002
max0.385-0.391=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1929.753-1929.750=0.004
σ0.018-0.013=0.004
min1929.740-1929.731=0.009
max1929.785-1929.765=0.020
mean2695.000-2694.000=1.000
σ0.000
min2695.000-2694.000=1.000
max2695.000-2694.000=1.000
mean2.969-3.025=-0.056
σ0.320-0.220=0.100
min2.469-2.783=-0.314
max3.324-3.387=-0.063
iters=5
new-facts=6402
prior-facts=1
mean4750.494-4750.510=-0.016
σ0.838-0.809=0.029
min4750.029-4750.091=-0.062
max4751.987-4751.955=0.032
mean2695.000-2694.000=1.000
σ0.000
min2695.000-2694.000=1.000
max2695.000-2694.000=1.000
mean8.449-8.350=0.100
σ0.500-0.392=0.107
min7.756-7.706=0.049
max8.968-8.728=0.240
iters=5
new-facts=6402
prior-facts=6402
mean4940.989-4940.854=0.135
σ0.012-0.182=-0.170
min4940.974-4940.629=0.345
max4941.004-4940.993=0.011
mean3030.000-3008.200=21.800
σ286.497-339.582=-53.085
min2695.000-2694.000=1.000
max3414.000-3506.000=-92.000
mean8.547-8.759=-0.212
σ0.174-0.465=-0.291
min8.360-8.290=0.070
max8.771-9.269=-0.498

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.070-1.164=-0.094
σ0.140-0.269=-0.129
min0.932-0.928=0.005
max1.241-1.459=-0.218

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.060-466.066=-0.006
σ574.941-574.945=-0.004
min178.583-178.589=-0.005
max1328.471-1328.483=-0.012
mean86.250
σ8.500
min82.000
max99.000
mean2695.000-2694.000=1.000
σ0.000
min2695.000-2694.000=1.000
max2695.000-2694.000=1.000
mean0.569-0.557=0.011
σ0.584-0.559=0.024
min0.275-0.267=0.008
max1.444-1.396=0.048
policies=20
mean1786.123-1786.147=-0.025
σ0.367-0.358=0.009
min1785.891-1785.927=-0.036
max1786.671-1786.683=-0.012
mean820.000
σ0.000
min820.000
max820.000
mean2695.000-2694.000=1.000
σ0.000
min2695.000-2694.000=1.000
max2695.000-2694.000=1.000
mean2.768-2.763=0.005
σ0.009-0.024=-0.015
min2.760-2.731=0.029
max2.777-2.785=-0.008
policies=200
mean17868.460-17868.462=-0.002
σ0.529-0.506=0.023
min17868.158-17868.169=-0.011
max17869.252-17869.220=0.032
mean8200.000
σ0.000
min8200.000
max8200.000
mean2695.000-2694.000=1.000
σ0.000
min2695.000-2694.000=1.000
max2695.000-2694.000=1.000
mean27.917-27.849=0.068
σ0.099-0.070=0.029
min27.795-27.778=0.016
max28.027-27.945=0.082