Compare commits

Home / Compare 1f3d5be9 .. 17d54493

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.381-70.379=0.002
σ0.047-0.047=-0.000
min70.350-70.349=0.001
max70.510-70.510=0.001
mean413.000-414.400=-1.400
σ0.000-0.516=-0.516
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.159-0.158=0.001
σ0.002-0.003=-0.001
min0.157-0.152=0.005
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.145-21.145=0.000
σ0.002-0.003=-0.001
min21.142-21.141=0.001
max21.149-21.150=-0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.065=-0.001
σ0.002-0.003=-0.000
min0.062-0.063=-0.001
max0.071-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.386-1752.386=-0.000
σ0.362-0.363=-0.001
min1751.826-1751.823=0.003
max1752.978-1752.967=0.011
mean1628.500-1632.800=-4.300
σ589.178-608.988=-19.809
min624.000-631.000=-7.000
max2412.000-2452.000=-40.000
mean2.816-2.855=-0.039
σ0.185-0.109=0.076
min2.147-2.592=-0.444
max3.128-3.051=0.077

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.132-270.129=0.003
σ0.004-0.007=-0.002
min270.126-270.120=0.005
max270.136-270.139=-0.003
mean2412.000-2452.000=-40.000
σ0.000
min2412.000-2452.000=-40.000
max2412.000-2452.000=-40.000
mean0.380-0.379=0.001
σ0.004-0.002=0.001
min0.378-0.377=0.001
max0.386-0.382=0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.593-1930.591=0.003
σ0.011-0.020=-0.009
min1930.574-1930.561=0.013
max1930.601-1930.606=-0.005
mean2412.000-2452.000=-40.000
σ0.000
min2412.000-2452.000=-40.000
max2412.000-2452.000=-40.000
mean2.590-2.555=0.035
σ0.162-0.101=0.061
min2.457-2.437=0.020
max2.793-2.678=0.116
iters=5
new-facts=6402
prior-facts=1
mean4751.122-4751.140=-0.018
σ0.844-0.779=0.065
min4750.623-4750.697=-0.074
max4752.619-4752.527=0.093
mean2412.000-2452.000=-40.000
σ0.000
min2412.000-2452.000=-40.000
max2412.000-2452.000=-40.000
mean8.174-8.080=0.094
σ0.579-0.309=0.270
min7.490-7.738=-0.248
max8.958-8.499=0.459
iters=5
new-facts=6402
prior-facts=6402
mean4941.386-4941.460=-0.074
σ0.108-0.206=-0.098
min4941.259-4941.116=0.144
max4941.480-4941.622=-0.142
mean2971.400-2907.000=64.400
σ431.433-399.470=31.963
min2479.000-2452.000=27.000
max3560.000-3436.000=124.000
mean8.411-8.347=0.064
σ0.133-0.030=0.103
min8.287-8.310=-0.023
max8.637-8.388=0.248

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.862-1.797=0.065
σ0.106-0.172=-0.066
min1.740-1.616=0.123
max1.984-2.083=-0.098

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.352-466.349=0.003
σ575.917-575.916=0.001
min178.388-178.391=-0.003
max1330.227-1330.223=0.004
mean84.000
σ8.000
min80.000
max96.000
mean2412.000-2452.000=-40.000
σ0.000
min2412.000-2452.000=-40.000
max2412.000-2452.000=-40.000
mean0.547-0.560=-0.013
σ0.535-0.550=-0.015
min0.276-0.282=-0.006
max1.350-1.385=-0.036
policies=20
mean1784.222-1784.191=0.030
σ0.359-0.355=0.005
min1783.988-1783.966=0.022
max1784.757-1784.719=0.037
mean800.000
σ0.000
min800.000
max800.000
mean2412.000-2452.000=-40.000
σ0.000
min2412.000-2452.000=-40.000
max2412.000-2452.000=-40.000
mean2.761-2.768=-0.007
σ0.016-0.022=-0.006
min2.746-2.751=-0.006
max2.777-2.800=-0.023
policies=200
mean17848.907-17848.899=0.009
σ0.477-0.484=-0.007
min17848.639-17848.584=0.055
max17849.622-17849.619=0.003
mean8000.000
σ0.000
min8000.000
max8000.000
mean2412.000-2452.000=-40.000
σ0.000
min2412.000-2452.000=-40.000
max2412.000-2452.000=-40.000
mean27.867-27.919=-0.053
σ0.041-0.060=-0.019
min27.831-27.830=0.001
max27.925-27.957=-0.033