Compare commits

Home / Compare 35e6a88c .. 9c357148

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.384-70.384=0.001
σ0.048-0.045=0.003
min70.353-70.354=-0.001
max70.518-70.509=0.010
mean421.000-414.400=6.600
σ0.000-0.516=-0.516
min421.000-414.000=7.000
max421.000-415.000=6.000
mean0.157-0.161=-0.003
σ0.005-0.004=0.000
min0.150-0.157=-0.006
max0.165-0.172=-0.007
cache=y
dps=1
iters=10
policies=100
mean21.141-21.141=0.000
σ0.003-0.002=0.001
min21.134-21.137=-0.003
max21.145-21.144=0.001
mean421.000-415.000=6.000
σ0.000
min421.000-415.000=6.000
max421.000-415.000=6.000
mean0.061-0.065=-0.003
σ0.004-0.002=0.002
min0.057-0.063=-0.006
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.392-1752.394=-0.001
σ0.360-0.362=-0.003
min1751.819-1751.826=-0.007
max1752.978-1752.979=-0.001
mean1662.750-1660.050=2.700
σ637.511-632.992=4.518
min621.000-618.000=3.000
max2795.000-2776.000=19.000
mean2.809-2.844=-0.035
σ0.168-0.106=0.061
min2.513-2.585=-0.072
max3.021-2.966=0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.141-270.140=0.001
σ0.003-0.007=-0.004
min270.137-270.130=0.006
max270.144-270.150=-0.006
mean2795.000-2776.000=19.000
σ0.000
min2795.000-2776.000=19.000
max2795.000-2776.000=19.000
mean0.380-0.376=0.005
σ0.005-0.004=0.000
min0.374-0.369=0.005
max0.387-0.380=0.007
iters=5
new-facts=1
prior-facts=6402
mean1930.594-1930.602=-0.009
σ0.026-0.020=0.006
min1930.562-1930.571=-0.008
max1930.617-1930.619=-0.002
mean2795.000-2776.000=19.000
σ0.000
min2795.000-2776.000=19.000
max2795.000-2776.000=19.000
mean2.595-2.526=0.070
σ0.137-0.071=0.065
min2.504-2.479=0.025
max2.837-2.649=0.189
iters=5
new-facts=6402
prior-facts=1
mean4751.302-4751.319=-0.017
σ0.898-0.865=0.033
min4750.745-4750.865=-0.121
max4752.899-4752.864=0.035
mean2795.000-2776.000=19.000
σ0.000
min2795.000-2776.000=19.000
max2795.000-2776.000=19.000
mean8.573-8.350=0.223
σ0.578-0.433=0.145
min7.654-7.684=-0.031
max9.187-8.738=0.448
iters=5
new-facts=6402
prior-facts=6402
mean4941.558-4941.694=-0.137
σ0.325-0.147=0.178
min4941.039-4941.433=-0.394
max4941.785-4941.785=-0.001
mean3040.600-3036.200=4.400
σ220.340-226.153=-5.813
min2795.000-2776.000=19.000
max3312.000-3314.000=-2.000
mean8.723-8.524=0.200
σ0.260-0.110=0.149
min8.452-8.406=0.046
max9.128-8.640=0.488

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.032-1.071=-0.039
σ0.133-0.230=-0.097
min0.941-0.936=0.005
max1.246-1.470=-0.225

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.378-466.379=-0.001
σ575.927-575.938=-0.011
min178.406-178.403=0.004
max1330.268-1330.285=-0.017
mean84.250
σ8.500
min80.000
max97.000
mean2795.000-2776.000=19.000
σ0.000
min2795.000-2776.000=19.000
max2795.000-2776.000=19.000
mean0.439-0.427=0.012
σ0.308-0.254=0.054
min0.272-0.288=-0.016
max0.902-0.808=0.093
policies=20
mean1784.365-1784.358=0.007
σ0.372-0.365=0.007
min1784.118-1784.097=0.021
max1784.916-1784.895=0.021
mean800.000
σ0.000
min800.000
max800.000
mean2795.000-2776.000=19.000
σ0.000
min2795.000-2776.000=19.000
max2795.000-2776.000=19.000
mean2.854-2.900=-0.045
σ0.114-0.113=0.000
min2.758-2.778=-0.021
max3.015-2.999=0.016
policies=200
mean17849.731-17849.636=0.096
σ0.406-0.611=-0.204
min17849.492-17849.278=0.214
max17850.336-17850.548=-0.213
mean8000.000
σ0.000
min8000.000
max8000.000
mean2795.000-2776.000=19.000
σ0.000
min2795.000-2776.000=19.000
max2795.000-2776.000=19.000
mean27.935-28.031=-0.096
σ0.022-0.137=-0.115
min27.915-27.909=0.005
max27.966-28.207=-0.241