Compare commits

Home / Compare 4b8a0455 .. 9db18eb7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.390=-0.001
σ0.044-0.047=-0.002
min70.360-70.361=-0.002
max70.512-70.520=-0.008
mean416.000-415.400=0.600
σ0.000-0.516=-0.516
min416.000-415.000=1.000
max416.000
mean0.157-0.160=-0.003
σ0.005-0.003=0.002
min0.147-0.157=-0.010
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.001
σ0.003-0.002=0.000
min21.140-21.140=0.000
max21.149-21.147=0.002
mean416.000
σ0.000
min416.000
max416.000
mean0.065-0.061=0.003
σ0.003-0.004=-0.002
min0.063-0.057=0.005
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.394=-0.001
σ0.360-0.360=-0.000
min1751.827-1751.827=0.000
max1752.980-1752.978=0.002
mean1657.050-1662.650=-5.600
σ615.649-622.380=-6.730
min638.000
max2492.000-2510.000=-18.000
mean2.789-2.745=0.044
σ0.175-0.220=-0.045
min2.367-2.266=0.101
max2.985-3.066=-0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.143-270.143=-0.000
σ0.006-0.006=0.001
min270.133-270.135=-0.002
max270.150-270.148=0.002
mean2492.000-2510.000=-18.000
σ0.000
min2492.000-2510.000=-18.000
max2492.000-2510.000=-18.000
mean0.379-0.381=-0.002
σ0.002-0.001=0.001
min0.376-0.379=-0.003
max0.381-0.382=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.590-1930.607=-0.017
σ0.023-0.015=0.008
min1930.554-1930.586=-0.032
max1930.613-1930.621=-0.008
mean2492.000-2510.000=-18.000
σ0.000
min2492.000-2510.000=-18.000
max2492.000-2510.000=-18.000
mean2.574-2.500=0.073
σ0.164-0.088=0.075
min2.411-2.431=-0.020
max2.829-2.632=0.197
iters=5
new-facts=6402
prior-facts=1
mean4751.289-4751.318=-0.030
σ0.927-0.906=0.021
min4750.785-4750.772=0.012
max4752.943-4752.927=0.016
mean2492.000-2510.000=-18.000
σ0.000
min2492.000-2510.000=-18.000
max2492.000-2510.000=-18.000
mean8.762-8.533=0.229
σ0.211-0.528=-0.317
min8.550-7.744=0.806
max9.060-9.127=-0.067
iters=5
new-facts=6402
prior-facts=6402
mean4941.775-4941.776=-0.001
σ0.020-0.016=0.004
min4941.752-4941.758=-0.006
max4941.799-4941.799=0.001
mean3012.200-3010.000=2.200
σ280.197-279.793=0.404
min2622.000-2619.000=3.000
max3322.000-3317.000=5.000
mean8.769-8.571=0.198
σ0.393-0.136=0.257
min8.376-8.392=-0.016
max9.361-8.720=0.641

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.706-1.791=-0.085
σ0.121-0.108=0.013
min1.501-1.605=-0.105
max1.812-1.865=-0.054

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.366-466.362=0.003
σ575.919-575.922=-0.003
min178.403-178.398=0.005
max1330.244-1330.245=-0.001
mean84.000
σ8.000
min80.000
max96.000
mean2492.000-2510.000=-18.000
σ0.000
min2492.000-2510.000=-18.000
max2492.000-2510.000=-18.000
mean0.586-0.561=0.026
σ0.603-0.558=0.045
min0.282-0.280=0.002
max1.491-1.398=0.093
policies=20
mean1784.325-1784.294=0.031
σ0.362-0.354=0.007
min1784.090-1784.069=0.021
max1784.863-1784.822=0.041
mean800.000
σ0.000
min800.000
max800.000
mean2492.000-2510.000=-18.000
σ0.000
min2492.000-2510.000=-18.000
max2492.000-2510.000=-18.000
mean2.784-2.778=0.007
σ0.010-0.013=-0.003
min2.776-2.768=0.009
max2.797-2.794=0.003
policies=200
mean17849.831-17849.777=0.054
σ0.327-0.400=-0.073
min17849.609-17849.474=0.135
max17850.316-17850.367=-0.050
mean8000.000
σ0.000
min8000.000
max8000.000
mean2492.000-2510.000=-18.000
σ0.000
min2492.000-2510.000=-18.000
max2492.000-2510.000=-18.000
mean28.014-28.026=-0.012
σ0.079-0.062=0.017
min27.936-27.975=-0.040
max28.107-28.116=-0.009