Compare commits

Home / Compare 45d8cf4c .. ffff4b3b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.395-70.391=0.004
σ0.048-0.048=-0.000
min70.370-70.360=0.009
max70.530-70.526=0.005
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.154-0.159=-0.004
σ0.005-0.003=0.002
min0.149-0.155=-0.007
max0.162-0.164=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.148-21.145=0.003
σ0.003-0.002=0.001
min21.144-21.143=0.001
max21.152-21.148=0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.064-0.064=-0.000
σ0.002-0.003=-0.001
min0.062-0.062=0.000
max0.068-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.393=0.000
σ0.359-0.360=-0.001
min1751.819-1751.829=-0.010
max1752.960-1752.966=-0.006
mean1651.950-1627.700=24.250
σ626.583-589.958=36.625
min627.000-625.000=2.000
max2852.000-2415.000=437.000
mean2.839-2.824=0.016
σ0.089-0.168=-0.079
min2.701-2.309=0.392
max3.011-3.057=-0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.126-270.123=0.003
σ0.012-0.008=0.003
min270.118-270.115=0.003
max270.146-270.136=0.010
mean2852.000-2415.000=437.000
σ0.000
min2852.000-2415.000=437.000
max2852.000-2415.000=437.000
mean0.378-0.383=-0.005
σ0.005-0.006=-0.001
min0.370-0.378=-0.008
max0.382-0.392=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.608-1930.605=0.003
σ0.006-0.008=-0.001
min1930.599-1930.598=0.001
max1930.617-1930.617=0.000
mean2852.000-2415.000=437.000
σ0.000
min2852.000-2415.000=437.000
max2852.000-2415.000=437.000
mean2.511-2.537=-0.027
σ0.075-0.150=-0.075
min2.453-2.446=0.007
max2.630-2.801=-0.171
iters=5
new-facts=6402
prior-facts=1
mean4751.331-4751.196=0.135
σ0.824-0.925=-0.101
min4750.926-4750.517=0.409
max4752.803-4752.825=-0.022
mean2852.000-2415.000=437.000
σ0.000
min2852.000-2415.000=437.000
max2852.000-2415.000=437.000
mean8.289-8.450=-0.162
σ0.361-0.481=-0.120
min7.701-7.661=0.039
max8.584-8.980=-0.396
iters=5
new-facts=6402
prior-facts=6402
mean4941.549-4941.697=-0.148
σ0.308-0.144=0.164
min4941.076-4941.440=-0.364
max4941.768-4941.777=-0.008
mean3078.800-3004.400=74.400
σ226.501-277.310=-50.809
min2852.000-2618.000=234.000
max3380.000-3312.000=68.000
mean8.736-8.504=0.232
σ0.404-0.070=0.334
min8.389-8.422=-0.034
max9.332-8.617=0.715

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-1.813=-0.816
σ0.130-0.123=0.006
min0.930-1.616=-0.686
max1.229-1.937=-0.709

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.368-466.361=0.007
σ575.922-575.916=0.006
min178.403-178.401=0.002
max1330.251-1330.235=0.015
mean84.000
σ8.000
min80.000
max96.000
mean2852.000-2415.000=437.000
σ0.000
min2852.000-2415.000=437.000
max2852.000-2415.000=437.000
mean0.439-0.548=-0.108
σ0.302-0.537=-0.235
min0.282-0.277=0.005
max0.892-1.353=-0.461
policies=20
mean1784.358-1784.312=0.045
σ0.359-0.346=0.012
min1784.108-1784.084=0.024
max1784.885-1784.826=0.059
mean800.000
σ0.000
min800.000
max800.000
mean2852.000-2415.000=437.000
σ0.000
min2852.000-2415.000=437.000
max2852.000-2415.000=437.000
mean2.863-2.794=0.069
σ0.005-0.070=-0.065
min2.857-2.750=0.107
max2.869-2.898=-0.030
policies=200
mean17849.665-17849.756=-0.091
σ0.551-0.486=0.065
min17849.372-17849.495=-0.123
max17850.490-17850.484=0.006
mean8000.000
σ0.000
min8000.000
max8000.000
mean2852.000-2415.000=437.000
σ0.000
min2852.000-2415.000=437.000
max2852.000-2415.000=437.000
mean28.466-27.923=0.544
σ0.399-0.052=0.347
min28.001-27.871=0.130
max28.803-27.975=0.828