Compare commits

Home / Compare dfd317c7 .. f85fbfd4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.731-70.741=-0.010
σ0.047-0.048=-0.001
min70.706-70.717=-0.011
max70.863-70.876=-0.013
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.162-0.161=0.001
σ0.003-0.004=-0.001
min0.158-0.158=0.001
max0.168-0.169=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.464-21.465=-0.001
σ0.003-0.003=-0.000
min21.459-21.461=-0.002
max21.467-21.470=-0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.000
min0.060-0.064=-0.003
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.459-1754.457=0.002
σ0.359-0.360=-0.002
min1753.889-1753.885=0.004
max1755.020-1755.028=-0.008
mean1672.400-1663.500=8.900
σ651.056-627.210=23.846
min624.000-674.000=-50.000
max2839.000-2606.000=233.000
mean2.831-2.772=0.059
σ0.126-0.167=-0.041
min2.374-2.513=-0.138
max2.972-3.069=-0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.506-273.505=0.000
σ0.007-0.004=0.003
min273.498-273.499=-0.001
max273.513-273.509=0.004
mean2839.000-2606.000=233.000
σ0.000
min2839.000-2606.000=233.000
max2839.000-2606.000=233.000
mean0.382-0.385=-0.003
σ0.005-0.004=0.001
min0.379-0.382=-0.004
max0.391-0.392=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.886-1933.905=-0.019
σ0.013-0.011=0.002
min1933.869-1933.893=-0.024
max1933.900-1933.923=-0.023
mean2839.000-2606.000=233.000
σ0.000
min2839.000-2606.000=233.000
max2839.000-2606.000=233.000
mean2.953-3.001=-0.048
σ0.144-0.333=-0.189
min2.735-2.456=0.279
max3.089-3.311=-0.222
iters=5
new-facts=6402
prior-facts=1
mean4754.665-4754.504=0.161
σ0.907-1.064=-0.158
min4754.158-4753.273=0.884
max4756.278-4756.211=0.066
mean2839.000-2606.000=233.000
σ0.000
min2839.000-2606.000=233.000
max2839.000-2606.000=233.000
mean8.597-8.004=0.593
σ0.390-0.484=-0.094
min8.244-7.751=0.493
max9.141-8.868=0.273
iters=5
new-facts=6402
prior-facts=6402
mean4945.044-4945.047=-0.003
σ0.147-0.165=-0.018
min4944.781-4944.754=0.027
max4945.113-4945.150=-0.037
mean3054.000-2962.000=92.000
σ211.039-362.278=-151.239
min2839.000-2606.000=233.000
max3324.000-3437.000=-113.000
mean8.615-8.565=0.050
σ0.153-0.277=-0.124
min8.468-8.365=0.104
max8.838-9.019=-0.182

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.004-1.339=-0.335
σ0.148-0.381=-0.233
min0.935-0.940=-0.005
max1.269-1.813=-0.544

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.579-473.057=-0.477
σ574.936-575.922=-0.986
min185.103-185.090=0.013
max1334.984-1336.940=-1.956
mean88.250
σ8.500
min84.000
max101.000
mean2839.000-2606.000=233.000
σ0.000
min2839.000-2606.000=233.000
max2839.000-2606.000=233.000
mean0.490-0.562=-0.072
σ0.381-0.549=-0.168
min0.298-0.284=0.014
max1.061-1.386=-0.324
policies=20
mean1851.302-1851.235=0.067
σ0.389-0.379=0.011
min1851.018-1850.984=0.034
max1851.872-1851.794=0.078
mean840.000
σ0.000
min840.000
max840.000
mean2839.000-2606.000=233.000
σ0.000
min2839.000-2606.000=233.000
max2839.000-2606.000=233.000
mean2.957-2.885=0.072
σ0.024-0.016=0.008
min2.939-2.867=0.072
max2.990-2.900=0.090
policies=200
mean18519.453-18519.392=0.061
σ0.494-0.524=-0.030
min18519.165-18519.026=0.139
max18520.191-18520.169=0.021
mean8400.000
σ0.000
min8400.000
max8400.000
mean2839.000-2606.000=233.000
σ0.000
min2839.000-2606.000=233.000
max2839.000-2606.000=233.000
mean29.127-28.948=0.179
σ0.498-0.099=0.399
min28.837-28.831=0.006
max29.872-29.058=0.814