Compare commits

Home / Compare eccdb107 .. e175c523

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.373=0.006
σ0.048-0.047=0.001
min70.344-70.344=0.001
max70.512-70.504=0.008
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.154-0.161=-0.007
σ0.016-0.007=0.009
min0.110-0.153=-0.042
max0.165-0.179=-0.014
cache=y
dps=1
iters=10
policies=100
mean21.143-21.144=-0.000
σ0.003-0.003=0.000
min21.140-21.140=0.001
max21.149-21.148=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.063-0.062=0.001
σ0.003-0.003=-0.000
min0.058-0.058=0.000
max0.067-0.067=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.388=-0.001
σ0.359-0.360=-0.000
min1751.817-1751.818=-0.002
max1752.950-1752.960=-0.010
mean1635.350-1639.400=-4.050
σ609.350-617.086=-7.736
min633.000-626.000=7.000
max2454.000-2474.000=-20.000
mean2.808-2.830=-0.021
σ0.164-0.125=0.038
min2.301-2.572=-0.271
max3.035-3.043=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.130-270.133=-0.002
σ0.004-0.004=-0.001
min270.126-270.127=-0.000
max270.137-270.139=-0.002
mean2454.000-2474.000=-20.000
σ0.000
min2454.000-2474.000=-20.000
max2454.000-2474.000=-20.000
mean0.378-0.386=-0.007
σ0.001-0.005=-0.004
min0.377-0.382=-0.005
max0.380-0.394=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1930.591-1930.585=0.006
σ0.018-0.020=-0.002
min1930.571-1930.559=0.012
max1930.611-1930.605=0.006
mean2454.000-2474.000=-20.000
σ0.000
min2454.000-2474.000=-20.000
max2454.000-2474.000=-20.000
mean2.496-2.522=-0.026
σ0.050-0.122=-0.072
min2.452-2.439=0.013
max2.573-2.730=-0.156
iters=5
new-facts=6402
prior-facts=1
mean4750.779-4751.037=-0.257
σ0.707-0.892=-0.185
min4750.189-4750.209=-0.021
max4751.946-4752.560=-0.614
mean2454.000-2474.000=-20.000
σ0.000
min2454.000-2474.000=-20.000
max2454.000-2474.000=-20.000
mean8.113-8.067=0.046
σ0.463-0.345=0.118
min7.574-7.718=-0.144
max8.652-8.621=0.031
iters=5
new-facts=6402
prior-facts=6402
mean4941.529-4941.523=0.007
σ0.090-0.093=-0.003
min4941.455-4941.448=0.006
max4941.635-4941.637=-0.002
mean3014.800-2929.000=85.800
σ259.761-396.410=-136.649
min2629.000-2474.000=155.000
max3323.000-3440.000=-117.000
mean8.534-8.377=0.157
σ0.225-0.096=0.130
min8.269-8.271=-0.002
max8.803-8.531=0.272

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.789-1.760=0.029
σ0.144-0.189=-0.045
min1.607-1.438=0.169
max2.001-1.923=0.078

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.356-466.358=-0.002
σ575.924-575.927=-0.004
min178.391-178.392=-0.001
max1330.242-1330.249=-0.007
mean84.000
σ8.000
min80.000
max96.000
mean2454.000-2474.000=-20.000
σ0.000
min2454.000-2474.000=-20.000
max2454.000-2474.000=-20.000
mean0.559-0.555=0.004
σ0.555-0.562=-0.007
min0.281-0.266=0.015
max1.391-1.398=-0.007
policies=20
mean1784.198-1784.224=-0.026
σ0.356-0.358=-0.003
min1783.973-1784.000=-0.027
max1784.728-1784.757=-0.030
mean800.000
σ0.000
min800.000
max800.000
mean2454.000-2474.000=-20.000
σ0.000
min2454.000-2474.000=-20.000
max2454.000-2474.000=-20.000
mean2.772-2.776=-0.004
σ0.024-0.019=0.005
min2.742-2.756=-0.014
max2.800-2.802=-0.002
policies=200
mean17848.842-17848.879=-0.036
σ0.498-0.446=0.053
min17848.438-17848.624=-0.187
max17849.568-17849.547=0.022
mean8000.000
σ0.000
min8000.000
max8000.000
mean2454.000-2474.000=-20.000
σ0.000
min2454.000-2474.000=-20.000
max2454.000-2474.000=-20.000
mean27.967-27.910=0.057
σ0.142-0.047=0.095
min27.837-27.872=-0.035
max28.169-27.978=0.191