Compare commits

Home / Compare 1276287c .. 5502ff7a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.655-53.654=0.001
σ0.371-0.369=0.002
min53.517-53.513=0.004
max54.709-54.703=0.006
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.137-0.135=0.002
σ0.004-0.006=-0.001
min0.132-0.128=0.004
max0.145-0.145=-0.000
cache=y
dps=1
iters=10
policies=100
mean42.981-42.981=0.000
σ0.006-0.006=0.000
min42.974-42.974=0.000
max42.995-42.990=0.005
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.119-0.120=-0.000
σ0.004-0.004=-0.000
min0.113-0.115=-0.002
max0.125-0.126=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.694-1013.697=-0.003
σ1.222-1.225=-0.003
min1013.111-1013.105=0.007
max1018.805-1018.816=-0.011
mean1060.050-1051.700=8.350
σ314.930-293.721=21.209
min595.000-614.000=-19.000
max1649.000-1440.000=209.000
mean1.638-1.624=0.014
σ0.085-0.052=0.033
min1.568-1.561=0.007
max1.911-1.754=0.157

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean334.287-334.129=0.158
σ0.230-0.221=0.010
min334.128-333.942=0.186
max334.906-334.708=0.198
mean2100.000-2146.000=-46.000
σ0.000
min2100.000-2146.000=-46.000
max2100.000-2146.000=-46.000
mean0.748-0.728=0.020
σ0.030-0.023=0.007
min0.713-0.699=0.014
max0.814-0.760=0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.410-294.405=0.005
σ0.017-0.019=-0.002
min294.389-294.382=0.007
max294.428-294.424=0.004
mean1649.000-1440.000=209.000
σ0.000
min1649.000-1440.000=209.000
max1649.000-1440.000=209.000
mean0.391-0.381=0.010
σ0.010-0.001=0.009
min0.383-0.380=0.003
max0.404-0.382=0.022
iters=5
new-facts=1
prior-facts=6402
mean1316.715-1316.704=0.011
σ0.086-0.079=0.007
min1316.565-1316.565=0.001
max1316.774-1316.759=0.015
mean1649.000-1440.000=209.000
σ0.000
min1649.000-1440.000=209.000
max1649.000-1440.000=209.000
mean1.909-1.886=0.024
σ0.070-0.032=0.038
min1.846-1.849=-0.002
max2.012-1.938=0.074
iters=5
new-facts=6402
prior-facts=1
mean1736.954-1736.962=-0.008
σ6.902-6.885=0.017
min1733.752-1733.785=-0.033
max1749.298-1749.277=0.021
mean1649.000-1440.000=209.000
σ0.000
min1649.000-1440.000=209.000
max1649.000-1440.000=209.000
mean3.053-3.115=-0.062
σ0.318-0.260=0.058
min2.620-2.855=-0.234
max3.506-3.405=0.101
iters=5
new-facts=6402
prior-facts=6402
mean1999.626-1999.660=-0.034
σ0.023-0.012=0.011
min1999.597-1999.646=-0.049
max1999.647-1999.674=-0.026
mean1838.600-1873.600=-35.000
σ191.539-240.648=-49.108
min1649.000-1550.000=99.000
max2100.000-2146.000=-46.000
mean3.186-3.354=-0.168
σ0.062-0.084=-0.022
min3.120-3.222=-0.102
max3.258-3.438=-0.180

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.124-1.688=-0.564
σ0.248-0.174=0.073
min0.913-1.418=-0.506
max1.447-1.845=-0.398

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean441.089-441.075=0.014
σ573.041-573.019=0.021
min154.566-154.560=0.006
max1300.650-1300.604=0.046
mean94.250
σ8.500
min90.000
max107.000
mean1649.000-1440.000=209.000
σ0.000
min1649.000-1440.000=209.000
max1649.000-1440.000=209.000
mean0.544-0.551=-0.008
σ0.562-0.570=-0.008
min0.261-0.261=-0.000
max1.387-1.406=-0.019
policies=20
mean1545.938-1545.935=0.002
σ0.327-0.371=-0.043
min1545.748-1545.703=0.045
max1546.428-1546.489=-0.061
mean900.000
σ0.000
min900.000
max900.000
mean1649.000-1440.000=209.000
σ0.000
min1649.000-1440.000=209.000
max1649.000-1440.000=209.000
mean2.628-2.670=-0.043
σ0.022-0.038=-0.016
min2.605-2.643=-0.038
max2.652-2.726=-0.073
policies=200
mean15467.035-15467.078=-0.043
σ0.136-0.066=0.070
min15466.874-15466.987=-0.113
max15467.158-15467.138=0.020
mean9000.000
σ0.000
min9000.000
max9000.000
mean1649.000-1440.000=209.000
σ0.000
min1649.000-1440.000=209.000
max1649.000-1440.000=209.000
mean26.818-26.609=0.209
σ0.287-0.128=0.159
min26.568-26.507=0.061
max27.222-26.783=0.439