Compare commits

Home / Compare 84a28d24 .. e4bd14bd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.571=-0.003
σ0.047-0.046=0.001
min70.545-70.542=0.003
max70.701-70.696=0.006
mean415.600-413.000=2.600
σ0.516-0.000=0.516
min415.000-413.000=2.000
max416.000-413.000=3.000
mean0.158-0.156=0.001
σ0.005-0.004=0.002
min0.147-0.149=-0.002
max0.168-0.163=0.005
cache=y
dps=1
iters=10
policies=100
mean21.292-21.291=0.001
σ0.003-0.002=0.001
min21.285-21.288=-0.003
max21.296-21.295=0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.064-0.062=0.002
σ0.003-0.004=-0.000
min0.058-0.058=-0.000
max0.071-0.066=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1749.770-1749.770=-0.001
σ0.362-0.361=0.001
min1749.195-1749.198=-0.003
max1750.353-1750.348=0.005
mean1671.450-1657.100=14.350
σ633.206-628.106=5.100
min683.000-626.000=57.000
max2706.000-2847.000=-141.000
mean2.840-2.822=0.018
σ0.143-0.137=0.006
min2.423-2.326=0.097
max3.037-2.983=0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean268.227-268.230=-0.003
σ0.010-0.006=0.004
min268.211-268.225=-0.014
max268.238-268.239=-0.001
mean2706.000-2847.000=-141.000
σ0.000
min2706.000-2847.000=-141.000
max2706.000-2847.000=-141.000
mean0.385-0.378=0.007
σ0.008-0.004=0.004
min0.376-0.375=0.001
max0.391-0.385=0.006
iters=5
new-facts=1
prior-facts=6402
mean1928.638-1928.631=0.007
σ0.009-0.011=-0.003
min1928.624-1928.616=0.008
max1928.647-1928.642=0.006
mean2706.000-2847.000=-141.000
σ0.000
min2706.000-2847.000=-141.000
max2706.000-2847.000=-141.000
mean3.050-3.044=0.007
σ0.124-0.111=0.014
min2.954-2.943=0.011
max3.242-3.218=0.024
iters=5
new-facts=6402
prior-facts=1
mean4749.406-4749.221=0.184
σ0.883-1.013=-0.131
min4748.875-4748.375=0.500
max4750.974-4750.981=-0.007
mean2706.000-2847.000=-141.000
σ0.000
min2706.000-2847.000=-141.000
max2706.000-2847.000=-141.000
mean8.396-8.836=-0.440
σ0.438-0.314=0.125
min7.951-8.408=-0.457
max8.974-9.150=-0.176
iters=5
new-facts=6402
prior-facts=6402
mean4939.831-4939.769=0.063
σ0.022-0.146=-0.125
min4939.805-4939.509=0.297
max4939.852-4939.851=0.001
mean3020.000-3057.800=-37.800
σ250.738-227.013=23.725
min2706.000-2847.000=-141.000
max3368.000-3395.000=-27.000
mean8.508-8.705=-0.198
σ0.214-0.312=-0.098
min8.240-8.407=-0.167
max8.803-9.154=-0.351

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.206-1.057=0.149
σ0.358-0.134=0.225
min0.939-0.939=-0.000
max1.795-1.265=0.530

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.504-465.507=-0.003
σ575.926-575.914=0.012
min177.535-177.545=-0.010
max1329.393-1329.378=0.015
mean86.250
σ8.500
min82.000
max99.000
mean2706.000-2847.000=-141.000
σ0.000
min2706.000-2847.000=-141.000
max2706.000-2847.000=-141.000
mean0.550-0.444=0.106
σ0.540-0.300=0.240
min0.278-0.292=-0.014
max1.360-0.894=0.465
policies=20
mean1775.661-1775.723=-0.063
σ0.369-0.372=-0.004
min1775.431-1775.465=-0.034
max1776.211-1776.272=-0.061
mean820.000
σ0.000
min820.000
max820.000
mean2706.000-2847.000=-141.000
σ0.000
min2706.000-2847.000=-141.000
max2706.000-2847.000=-141.000
mean2.773-2.863=-0.091
σ0.018-0.017=0.001
min2.761-2.846=-0.085
max2.799-2.882=-0.083
policies=200
mean17763.868-17763.907=-0.039
σ0.593-0.548=0.045
min17763.495-17763.510=-0.015
max17764.741-17764.701=0.040
mean8200.000
σ0.000
min8200.000
max8200.000
mean2706.000-2847.000=-141.000
σ0.000
min2706.000-2847.000=-141.000
max2706.000-2847.000=-141.000
mean27.905-28.465=-0.560
σ0.131-0.398=-0.267
min27.727-28.005=-0.278
max28.043-28.826=-0.784