Compare commits

Home / Compare 8404c660 .. bd4ab6b7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=0.000
σ0.051-0.049=0.002
min33.945-33.937=0.008
max34.121-34.115=0.006
mean415.000
σ0.000
min415.000
max415.000
mean0.084-0.084=-0.000
σ0.003-0.003=-0.001
min0.081-0.081=0.001
max0.089-0.090=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=-0.001
σ0.003-0.003=0.000
min23.315-23.314=0.001
max23.324-23.324=-0.000
mean415.000
σ0.000
min415.000
max415.000
mean0.065-0.065=0.000
σ0.002-0.002=0.000
min0.064-0.063=0.001
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.303=-0.000
σ0.365-0.364=0.001
min1756.728-1756.727=0.001
max1757.888-1757.893=-0.005
mean1646.400-1667.100=-20.700
σ623.325-626.211=-2.886
min638.000-666.000=-28.000
max2825.000-2613.000=212.000
mean2.381-2.370=0.011
σ0.079-0.161=-0.082
min2.246-2.174=0.071
max2.574-2.833=-0.258

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.453-326.449=0.004
σ0.041-0.043=-0.002
min326.381-326.375=0.005
max326.477-326.485=-0.007
mean2825.000-2613.000=212.000
σ0.000
min2825.000-2613.000=212.000
max2825.000-2613.000=212.000
mean0.424-0.429=-0.004
σ0.002-0.004=-0.002
min0.421-0.425=-0.004
max0.426-0.435=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1988.603-1988.616=-0.013
σ0.010-0.010=-0.000
min1988.590-1988.600=-0.010
max1988.616-1988.626=-0.009
mean2825.000-2613.000=212.000
σ0.000
min2825.000-2613.000=212.000
max2825.000-2613.000=212.000
mean2.724-2.687=0.036
σ0.172-0.116=0.056
min2.540-2.618=-0.078
max2.943-2.895=0.049
iters=5
new-facts=6402
prior-facts=1
mean4813.362-4813.348=0.015
σ7.790-7.702=0.088
min4809.353-4809.426=-0.073
max4827.286-4827.116=0.170
mean2825.000-2613.000=212.000
σ0.000
min2825.000-2613.000=212.000
max2825.000-2613.000=212.000
mean8.439-8.577=-0.137
σ0.521-0.379=0.141
min7.938-8.271=-0.333
max9.240-9.061=0.178
iters=5
new-facts=6402
prior-facts=6402
mean5000.794-5000.940=-0.145
σ0.184-0.166=0.018
min5000.645-5000.644=0.001
max5001.015-5001.035=-0.020
mean3056.400-3000.000=56.400
σ310.902-283.716=27.186
min2825.000-2613.000=212.000
max3538.000-3372.000=166.000
mean9.703-9.799=-0.095
σ0.233-0.150=0.084
min9.324-9.638=-0.314
max9.965-10.001=-0.036

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.089-1.222=-0.133
σ0.241-0.343=-0.102
min0.916-0.922=-0.006
max1.505-1.628=-0.123

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.441-464.435=0.006
σ574.772-574.785=-0.013
min177.043-177.040=0.002
max1326.599-1326.613=-0.013
mean88.250
σ8.500
min84.000
max101.000
mean2825.000-2613.000=212.000
σ0.000
min2825.000-2613.000=212.000
max2825.000-2613.000=212.000
mean0.438-0.546=-0.108
σ0.306-0.546=-0.240
min0.279-0.269=0.010
max0.898-1.366=-0.469
policies=20
mean1770.792-1770.748=0.044
σ0.369-0.358=0.011
min1770.536-1770.509=0.027
max1771.339-1771.279=0.059
mean840.000
σ0.000
min840.000
max840.000
mean2825.000-2613.000=212.000
σ0.000
min2825.000-2613.000=212.000
max2825.000-2613.000=212.000
mean2.780-2.719=0.060
σ0.022-0.015=0.006
min2.750-2.702=0.048
max2.801-2.735=0.066
policies=200
mean17714.808-17714.654=0.155
σ0.466-0.468=-0.002
min17714.392-17714.333=0.059
max17715.458-17715.348=0.110
mean8400.000
σ0.000
min8400.000
max8400.000
mean2825.000-2613.000=212.000
σ0.000
min2825.000-2613.000=212.000
max2825.000-2613.000=212.000
mean27.940-27.324=0.616
σ0.379-0.106=0.273
min27.522-27.199=0.323
max28.351-27.454=0.896