Compare commits

Home / Compare f13d442f .. c67f20aa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.380=-0.000
σ0.047-0.048=-0.001
min70.357-70.348=0.010
max70.510-70.514=-0.004
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.160-0.161=-0.002
σ0.005-0.003=0.002
min0.155-0.156=-0.000
max0.172-0.166=0.005
cache=y
dps=1
iters=10
policies=100
mean21.145-21.145=-0.001
σ0.002-0.002=-0.001
min21.142-21.141=0.000
max21.147-21.149=-0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.062-0.065=-0.003
σ0.003-0.003=0.001
min0.058-0.063=-0.006
max0.067-0.073=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.388-1714.476=37.912
σ0.361-169.594=-169.233
min1751.821-993.954=757.867
max1752.975-1752.970=0.005
mean1654.700-1617.300=37.400
σ616.423-611.329=5.094
min636.000-638.000=-2.000
max2492.000-2466.000=26.000
mean2.798-2.742=0.056
σ0.186-0.350=-0.164
min2.316-1.431=0.885
max3.094-3.042=0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.126-270.124=0.002
σ0.006-0.002=0.004
min270.119-270.121=-0.002
max270.134-270.126=0.008
mean2492.000-2466.000=26.000
σ0.000
min2492.000-2466.000=26.000
max2492.000-2466.000=26.000
mean0.382-0.374=0.008
σ0.010-0.006=0.004
min0.372-0.370=0.001
max0.393-0.385=0.008
iters=5
new-facts=1
prior-facts=6402
mean1930.589-1930.595=-0.006
σ0.019-0.007=0.012
min1930.558-1930.584=-0.026
max1930.605-1930.604=0.002
mean2492.000-2466.000=26.000
σ0.000
min2492.000-2466.000=26.000
max2492.000-2466.000=26.000
mean2.528-2.552=-0.024
σ0.091-0.118=-0.027
min2.441-2.457=-0.016
max2.640-2.744=-0.104
iters=5
new-facts=6402
prior-facts=1
mean4751.132-4751.069=0.063
σ0.789-0.884=-0.095
min4750.660-4750.535=0.125
max4752.534-4752.640=-0.106
mean2492.000-2466.000=26.000
σ0.000
min2492.000-2466.000=26.000
max2492.000-2466.000=26.000
mean8.087-8.511=-0.424
σ0.371-0.580=-0.210
min7.713-7.601=0.112
max8.504-9.147=-0.643
iters=5
new-facts=6402
prior-facts=6402
mean4941.384-4941.530=-0.146
σ0.198-0.085=0.113
min4941.100-4941.452=-0.352
max4941.610-4941.626=-0.015
mean2945.000-3016.600=-71.600
σ417.886-271.895=145.992
min2492.000-2621.000=-129.000
max3508.000-3351.000=157.000
mean8.387-8.492=-0.105
σ0.087-0.140=-0.053
min8.282-8.353=-0.070
max8.487-8.652=-0.164

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.609-1.525=0.085
σ0.153-0.277=-0.124
min1.445-1.221=0.224
max1.830-1.845=-0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.353-466.356=-0.002
σ575.920-575.925=-0.004
min178.389-178.389=0.000
max1330.234-1330.243=-0.009
mean84.000
σ8.000
min80.000
max96.000
mean2492.000-2466.000=26.000
σ0.000
min2492.000-2466.000=26.000
max2492.000-2466.000=26.000
mean0.559-0.569=-0.010
σ0.550-0.578=-0.028
min0.279-0.277=0.003
max1.384-1.436=-0.052
policies=20
mean1784.209-1784.221=-0.012
σ0.362-0.357=0.006
min1783.968-1783.991=-0.023
max1784.747-1784.751=-0.004
mean800.000
σ0.000
min800.000
max800.000
mean2492.000-2466.000=26.000
σ0.000
min2492.000-2466.000=26.000
max2492.000-2466.000=26.000
mean2.776-2.778=-0.002
σ0.013-0.013=-0.000
min2.766-2.766=-0.000
max2.794-2.796=-0.002
policies=200
mean17848.851-17848.893=-0.042
σ0.447-0.475=-0.028
min17848.550-17848.611=-0.061
max17849.515-17849.604=-0.089
mean8000.000
σ0.000
min8000.000
max8000.000
mean2492.000-2466.000=26.000
σ0.000
min2492.000-2466.000=26.000
max2492.000-2466.000=26.000
mean27.967-27.968=-0.001
σ0.125-0.142=-0.016
min27.873-27.855=0.018
max28.148-28.176=-0.028