Compare commits

Home / Compare 3aab30ce .. d7f1568a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.391=-0.001
σ0.047-0.048=-0.001
min70.361-70.360=0.001
max70.522-70.523=-0.002
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.161-0.162=-0.001
σ0.003-0.003=0.000
min0.157-0.159=-0.002
max0.165-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.003-0.002=0.001
min21.141-21.140=0.001
max21.149-21.147=0.002
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.064-0.063=0.001
σ0.002-0.003=-0.002
min0.063-0.059=0.004
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.700-1752.699=0.002
σ0.364-0.361=0.002
min1752.130-1752.130=-0.000
max1753.284-1753.279=0.005
mean1660.850-1644.350=16.500
σ634.374-634.490=-0.116
min617.000
max2772.000-2815.000=-43.000
mean2.784-2.827=-0.044
σ0.201-0.156=0.045
min2.268-2.377=-0.109
max3.075-3.083=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.513-270.513=-0.000
σ0.007-0.007=-0.000
min270.504-270.504=-0.001
max270.522-270.521=0.001
mean2772.000-2815.000=-43.000
σ0.000
min2772.000-2815.000=-43.000
max2772.000-2815.000=-43.000
mean0.383-0.381=0.002
σ0.005-0.005=-0.001
min0.379-0.378=0.001
max0.391-0.391=0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.941-1930.949=-0.009
σ0.010-0.012=-0.002
min1930.930-1930.940=-0.010
max1930.955-1930.970=-0.015
mean2772.000-2815.000=-43.000
σ0.000
min2772.000-2815.000=-43.000
max2772.000-2815.000=-43.000
mean2.984-2.900=0.084
σ0.093-0.247=-0.154
min2.893-2.466=0.426
max3.109-3.092=0.017
iters=5
new-facts=6402
prior-facts=1
mean4751.647-4751.553=0.093
σ0.906-0.975=-0.070
min4751.179-4750.721=0.458
max4753.265-4753.246=0.019
mean2772.000-2815.000=-43.000
σ0.000
min2772.000-2815.000=-43.000
max2772.000-2815.000=-43.000
mean8.621-8.618=0.003
σ0.436-0.124=0.312
min7.906-8.451=-0.544
max9.030-8.781=0.249
iters=5
new-facts=6402
prior-facts=6402
mean4942.146-4942.145=0.001
σ0.015-0.012=0.004
min4942.129-4942.129=-0.000
max4942.158-4942.158=-0.000
mean3002.400-3053.200=-50.800
σ228.811-221.650=7.161
min2772.000-2815.000=-43.000
max3338.000-3368.000=-30.000
mean8.529-8.506=0.023
σ0.131-0.237=-0.106
min8.404-8.304=0.100
max8.726-8.824=-0.098

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.998-1.040=-0.042
σ0.141-0.125=0.015
min0.931-0.927=0.005
max1.249-1.233=0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.826-466.825=0.000
σ575.927-575.926=0.000
min178.853-178.854=-0.001
max1330.716-1330.715=0.001
mean84.000
σ8.000
min80.000
max96.000
mean2772.000-2815.000=-43.000
σ0.000
min2772.000-2815.000=-43.000
max2772.000-2815.000=-43.000
mean0.443-0.437=0.006
σ0.300-0.295=0.004
min0.290-0.283=0.007
max0.892-0.880=0.012
policies=20
mean1788.849-1788.827=0.022
σ0.351-0.355=-0.004
min1788.597-1788.578=0.020
max1789.357-1789.349=0.008
mean800.000
σ0.000
min800.000
max800.000
mean2772.000-2815.000=-43.000
σ0.000
min2772.000-2815.000=-43.000
max2772.000-2815.000=-43.000
mean2.840-2.857=-0.017
σ0.113-0.064=0.049
min2.779-2.785=-0.005
max3.009-2.941=0.068
policies=200
mean17894.655-17894.693=-0.038
σ0.466-0.516=-0.050
min17894.369-17894.342=0.027
max17895.344-17895.451=-0.107
mean8000.000
σ0.000
min8000.000
max8000.000
mean2772.000-2815.000=-43.000
σ0.000
min2772.000-2815.000=-43.000
max2772.000-2815.000=-43.000
mean28.118-27.976=0.142
σ0.152-0.125=0.028
min27.932-27.876=0.055
max28.303-28.155=0.149