Compare commits

Home / Compare 543a0058 .. 72c8b3dd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.381=-0.000
σ0.049-0.046=0.003
min70.351-70.356=-0.004
max70.516-70.508=0.008
mean414.000-417.900=-3.900
σ0.000-0.316=-0.316
min414.000-417.000=-3.000
max414.000-418.000=-4.000
mean0.160-0.159=0.001
σ0.003-0.003=-0.000
min0.156-0.154=0.003
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.145-21.143=0.001
σ0.002-0.004=-0.001
min21.140-21.139=0.001
max21.148-21.149=-0.002
mean414.000-418.800=-4.800
σ0.000-0.422=-0.422
min414.000-418.000=-4.000
max414.000-419.000=-5.000
mean0.065-0.065=0.000
σ0.003-0.003=0.001
min0.060-0.063=-0.003
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.388-1752.386=0.001
σ0.361-0.360=0.001
min1751.823-1751.818=0.005
max1752.973-1752.967=0.006
mean1653.750-1668.650=-14.900
σ644.459-623.681=20.777
min620.000-638.000=-18.000
max2777.000-2518.000=259.000
mean2.826-2.812=0.014
σ0.139-0.088=0.051
min2.516-2.551=-0.036
max3.110-2.928=0.182

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.128-270.128=0.000
σ0.009-0.005=0.004
min270.116-270.119=-0.003
max270.141-270.133=0.008
mean2777.000-2518.000=259.000
σ0.000
min2777.000-2518.000=259.000
max2777.000-2518.000=259.000
mean0.380-0.380=-0.000
σ0.002-0.005=-0.004
min0.378-0.373=0.005
max0.382-0.388=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.589-1930.597=-0.007
σ0.009-0.011=-0.001
min1930.576-1930.583=-0.007
max1930.602-1930.610=-0.008
mean2777.000-2518.000=259.000
σ0.000
min2777.000-2518.000=259.000
max2777.000-2518.000=259.000
mean2.648-2.522=0.126
σ0.132-0.093=0.039
min2.438-2.443=-0.004
max2.791-2.665=0.126
iters=5
new-facts=6402
prior-facts=1
mean4750.946-4751.102=-0.156
σ0.968-0.853=0.116
min4749.929-4750.659=-0.730
max4752.558-4752.626=-0.068
mean2777.000-2518.000=259.000
σ0.000
min2777.000-2518.000=259.000
max2777.000-2518.000=259.000
mean8.692-8.389=0.303
σ0.394-0.577=-0.184
min8.025-7.621=0.404
max9.043-9.025=0.018
iters=5
new-facts=6402
prior-facts=6402
mean4941.531-4941.532=-0.000
σ0.082-0.089=-0.007
min4941.453-4941.462=-0.010
max4941.635-4941.630=0.005
mean3024.000-3027.200=-3.200
σ256.790-261.937=-5.148
min2777.000-2635.000=142.000
max3289.000-3334.000=-45.000
mean8.857-8.527=0.330
σ0.444-0.105=0.339
min8.529-8.395=0.134
max9.613-8.630=0.983

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.998-1.696=-0.698
σ0.126-0.201=-0.075
min0.939-1.384=-0.445
max1.223-1.870=-0.647

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.364-466.354=0.011
σ575.918-575.920=-0.002
min178.397-178.391=0.006
max1330.241-1330.234=0.007
mean84.000
σ8.000
min80.000
max96.000
mean2777.000-2518.000=259.000
σ0.000
min2777.000-2518.000=259.000
max2777.000-2518.000=259.000
mean0.445-0.567=-0.121
σ0.303-0.564=-0.261
min0.289-0.279=0.010
max0.900-1.413=-0.513
policies=20
mean1784.277-1784.207=0.070
σ0.341-0.368=-0.027
min1784.023-1783.977=0.046
max1784.778-1784.755=0.023
mean800.000
σ0.000
min800.000
max800.000
mean2777.000-2518.000=259.000
σ0.000
min2777.000-2518.000=259.000
max2777.000-2518.000=259.000
mean2.864-2.793=0.070
σ0.070-0.020=0.049
min2.779-2.772=0.007
max2.948-2.814=0.135
policies=200
mean17848.783-17848.912=-0.128
σ0.610-0.482=0.128
min17848.375-17848.639=-0.265
max17849.687-17849.633=0.054
mean8000.000
σ0.000
min8000.000
max8000.000
mean2777.000-2518.000=259.000
σ0.000
min2777.000-2518.000=259.000
max2777.000-2518.000=259.000
mean28.148-27.955=0.193
σ0.177-0.081=0.096
min27.984-27.855=0.130
max28.381-28.045=0.336