Compare commits

Home / Compare da59a517 .. 4ab529a7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.391-70.389=0.002
σ0.048-0.049=-0.000
min70.361-70.358=0.003
max70.524-70.523=0.001
mean412.000-411.600=0.400
σ0.000-0.516=-0.516
min412.000-411.000=1.000
max412.000
mean0.160-0.160=-0.000
σ0.003-0.007=-0.005
min0.158-0.151=0.007
max0.166-0.174=-0.008
cache=y
dps=1
iters=10
policies=100
mean21.145-21.146=-0.000
σ0.003-0.002=0.001
min21.141-21.142=-0.001
max21.150-21.149=0.002
mean412.000
σ0.000
min412.000
max412.000
mean0.065-0.065=-0.001
σ0.003-0.002=0.000
min0.063-0.063=-0.000
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.393=-0.000
σ0.362-0.360=0.002
min1751.827-1751.823=0.003
max1752.977-1752.976=0.001
mean1652.600-1651.650=0.950
σ627.386-617.301=10.085
min615.000-634.000=-19.000
max2769.000-2491.000=278.000
mean2.798-2.824=-0.026
σ0.163-0.141=0.022
min2.356-2.429=-0.073
max2.988-2.998=-0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.140-270.144=-0.004
σ0.006-0.006=0.000
min270.136-270.139=-0.003
max270.150-270.151=-0.001
mean2769.000-2491.000=278.000
σ0.000
min2769.000-2491.000=278.000
max2769.000-2491.000=278.000
mean0.380-0.381=-0.001
σ0.002-0.006=-0.004
min0.378-0.374=0.004
max0.382-0.390=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1930.606-1930.608=-0.003
σ0.004-0.004=0.000
min1930.602-1930.605=-0.003
max1930.611-1930.615=-0.003
mean2769.000-2491.000=278.000
σ0.000
min2769.000-2491.000=278.000
max2769.000-2491.000=278.000
mean2.532-2.567=-0.035
σ0.088-0.165=-0.077
min2.453-2.444=0.009
max2.680-2.855=-0.175
iters=5
new-facts=6402
prior-facts=1
mean4751.300-4751.273=0.027
σ0.915-0.958=-0.043
min4750.820-4750.750=0.069
max4752.929-4752.983=-0.054
mean2769.000-2491.000=278.000
σ0.000
min2769.000-2491.000=278.000
max2769.000-2491.000=278.000
mean8.489-8.849=-0.360
σ0.588-0.270=0.318
min7.717-8.565=-0.848
max9.017-9.279=-0.263
iters=5
new-facts=6402
prior-facts=6402
mean4941.702-4941.564=0.138
σ0.143-0.308=-0.165
min4941.446-4941.092=0.355
max4941.779-4941.781=-0.001
mean3016.400-3034.000=-17.600
σ231.103-324.895=-93.792
min2769.000-2589.000=180.000
max3320.000-3341.000=-21.000
mean8.581-8.691=-0.110
σ0.204-0.163=0.042
min8.408-8.447=-0.039
max8.918-8.895=0.023

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.750=-0.720
σ0.134-0.158=-0.023
min0.941-1.521=-0.580
max1.251-1.893=-0.642

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.369-466.363=0.007
σ575.919-575.921=-0.002
min178.399-178.399=0.000
max1330.248-1330.244=0.004
mean84.000
σ8.000
min80.000
max96.000
mean2769.000-2491.000=278.000
σ0.000
min2769.000-2491.000=278.000
max2769.000-2491.000=278.000
mean0.446-0.580=-0.135
σ0.308-0.587=-0.279
min0.289-0.282=0.007
max0.908-1.461=-0.553
policies=20
mean1784.306-1784.312=-0.006
σ0.333-0.362=-0.029
min1784.059-1784.074=-0.015
max1784.787-1784.850=-0.063
mean800.000
σ0.000
min800.000
max800.000
mean2769.000-2491.000=278.000
σ0.000
min2769.000-2491.000=278.000
max2769.000-2491.000=278.000
mean2.839-2.788=0.051
σ0.093-0.010=0.083
min2.782-2.779=0.004
max2.976-2.800=0.176
policies=200
mean17849.641-17849.880=-0.239
σ0.532-0.466=0.066
min17849.271-17849.511=-0.241
max17850.412-17850.562=-0.150
mean8000.000
σ0.000
min8000.000
max8000.000
mean2769.000-2491.000=278.000
σ0.000
min2769.000-2491.000=278.000
max2769.000-2491.000=278.000
mean28.032-28.082=-0.050
σ0.101-0.159=-0.058
min27.931-27.882=0.049
max28.149-28.267=-0.118