Compare commits

Home / Compare 0ab97a19 .. c121c7f8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.380=-0.001
σ0.048-0.047=0.001
min70.353-70.350=0.003
max70.514-70.511=0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.160-0.161=-0.001
σ0.003-0.003=-0.000
min0.158-0.157=0.001
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.002-0.002=-0.000
min21.140-21.140=0.000
max21.148-21.147=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.060-0.065=-0.005
σ0.003-0.002=0.001
min0.058-0.063=-0.006
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.388-1752.385=0.002
σ0.361-0.363=-0.002
min1751.812-1751.818=-0.006
max1752.982-1752.975=0.007
mean1631.100-1638.550=-7.450
σ597.689-603.622=-5.933
min624.000-633.000=-9.000
max2412.000-2431.000=-19.000
mean2.784-2.765=0.019
σ0.204-0.184=0.020
min2.181-2.213=-0.032
max3.015-2.954=0.061

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.128-270.133=-0.005
σ0.004-0.004=-0.000
min270.123-270.127=-0.004
max270.132-270.137=-0.005
mean2412.000-2431.000=-19.000
σ0.000
min2412.000-2431.000=-19.000
max2412.000-2431.000=-19.000
mean0.382-0.381=0.001
σ0.003-0.002=0.001
min0.380-0.378=0.002
max0.388-0.384=0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.590-1930.592=-0.003
σ0.010-0.012=-0.002
min1930.577-1930.578=-0.001
max1930.601-1930.607=-0.006
mean2412.000-2431.000=-19.000
σ0.000
min2412.000-2431.000=-19.000
max2412.000-2431.000=-19.000
mean2.525-2.610=-0.085
σ0.124-0.163=-0.039
min2.455-2.451=0.003
max2.744-2.878=-0.134
iters=5
new-facts=6402
prior-facts=1
mean4751.102-4750.954=0.148
σ0.876-0.629=0.246
min4750.628-4750.478=0.150
max4752.661-4752.059=0.602
mean2412.000-2431.000=-19.000
σ0.000
min2412.000-2431.000=-19.000
max2412.000-2431.000=-19.000
mean8.381-8.650=-0.269
σ0.712-0.526=0.186
min7.626-7.810=-0.184
max9.149-9.076=0.073
iters=5
new-facts=6402
prior-facts=6402
mean4941.531-4941.540=-0.009
σ0.091-0.082=0.009
min4941.456-4941.469=-0.013
max4941.636-4941.630=0.007
mean3021.400-2993.800=27.600
σ327.001-437.182=-110.180
min2571.000-2431.000=140.000
max3322.000-3561.000=-239.000
mean8.774-8.711=0.063
σ0.234-0.272=-0.037
min8.555-8.542=0.013
max9.084-9.191=-0.107

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.861-1.774=0.087
σ0.091-0.074=0.017
min1.712-1.681=0.032
max1.948-1.887=0.062

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.361-466.361=-0.000
σ575.937-575.933=0.003
min178.389-178.390=-0.000
max1330.266-1330.261=0.005
mean84.000
σ8.000
min80.000
max96.000
mean2412.000-2431.000=-19.000
σ0.000
min2412.000-2431.000=-19.000
max2412.000-2431.000=-19.000
mean0.547-0.554=-0.006
σ0.528-0.546=-0.018
min0.275-0.278=-0.003
max1.338-1.373=-0.034
policies=20
mean1784.219-1784.224=-0.006
σ0.355-0.357=-0.001
min1783.984-1783.999=-0.015
max1784.746-1784.755=-0.009
mean800.000
σ0.000
min800.000
max800.000
mean2412.000-2431.000=-19.000
σ0.000
min2412.000-2431.000=-19.000
max2412.000-2431.000=-19.000
mean2.801-2.772=0.029
σ0.053-0.014=0.039
min2.752-2.760=-0.007
max2.874-2.792=0.082
policies=200
mean17848.643-17848.606=0.037
σ0.396-0.773=-0.377
min17848.317-17847.744=0.573
max17849.216-17849.621=-0.405
mean8000.000
σ0.000
min8000.000
max8000.000
mean2412.000-2431.000=-19.000
σ0.000
min2412.000-2431.000=-19.000
max2412.000-2431.000=-19.000
mean27.969-27.923=0.046
σ0.210-0.087=0.123
min27.823-27.846=-0.023
max28.281-28.029=0.252