Compare commits

Home / Compare c361111e .. 07e6e00d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.048-0.049=-0.001
min33.948-33.949=-0.002
max34.111-34.115=-0.004
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.084-0.080=0.004
σ0.003-0.004=-0.001
min0.081-0.076=0.006
max0.090-0.085=0.005
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.003-0.003=-0.000
min23.314-23.313=0.001
max23.324-23.324=0.000
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.064-0.066=-0.002
σ0.004-0.003=0.001
min0.060-0.064=-0.004
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.362-1757.364=-0.001
σ0.363-0.366=-0.003
min1756.785-1756.789=-0.004
max1757.952-1757.954=-0.001
mean1628.850-1663.700=-34.850
σ627.097-647.538=-20.441
min653.000-627.000=26.000
max2829.000-2817.000=12.000
mean2.361-2.354=0.007
σ0.127-0.110=0.017
min2.255-2.210=0.045
max2.669-2.637=0.032

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.508-326.480=0.028
σ0.050-0.048=0.003
min326.418-326.397=0.022
max326.536-326.513=0.023
mean2829.000-2817.000=12.000
σ0.000
min2829.000-2817.000=12.000
max2829.000-2817.000=12.000
mean0.430-0.432=-0.002
σ0.009-0.010=-0.000
min0.424-0.422=0.002
max0.446-0.445=0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.674-1988.678=-0.004
σ0.004-0.004=-0.000
min1988.669-1988.672=-0.004
max1988.678-1988.684=-0.006
mean2829.000-2817.000=12.000
σ0.000
min2829.000-2817.000=12.000
max2829.000-2817.000=12.000
mean2.726-2.723=0.003
σ0.164-0.094=0.070
min2.592-2.667=-0.075
max3.012-2.890=0.122
iters=5
new-facts=6402
prior-facts=1
mean4813.531-4813.586=-0.056
σ7.775-7.755=0.021
min4810.010-4809.964=0.047
max4827.440-4827.456=-0.016
mean2829.000-2817.000=12.000
σ0.000
min2829.000-2817.000=12.000
max2829.000-2817.000=12.000
mean8.898-8.493=0.405
σ0.406-0.924=-0.518
min8.331-7.710=0.621
max9.388-9.831=-0.443
iters=5
new-facts=6402
prior-facts=6402
mean5001.010-5001.077=-0.066
σ0.166-0.030=0.136
min5000.720-5001.042=-0.321
max5001.145-5001.119=0.025
mean3056.200-3054.600=1.600
σ192.289-308.413=-116.124
min2829.000-2817.000=12.000
max3323.000-3527.000=-204.000
mean9.913-9.829=0.084
σ0.348-0.112=0.236
min9.496-9.714=-0.218
max10.442-10.004=0.437

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.944-0.951=-0.007
σ0.060-0.066=-0.005
min0.898-0.908=-0.010
max1.048-1.065=-0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.497-464.505=-0.008
σ574.767-574.772=-0.005
min177.107-177.108=-0.001
max1326.647-1326.663=-0.015
mean88.250
σ8.500
min84.000
max101.000
mean2829.000-2817.000=12.000
σ0.000
min2829.000-2817.000=12.000
max2829.000-2817.000=12.000
mean0.434-0.437=-0.004
σ0.308-0.307=0.000
min0.278-0.278=-0.001
max0.895-0.898=-0.003
policies=20
mean1771.411-1771.433=-0.022
σ0.370-0.368=0.003
min1771.161-1771.175=-0.014
max1771.960-1771.975=-0.015
mean840.000
σ0.000
min840.000
max840.000
mean2829.000-2817.000=12.000
σ0.000
min2829.000-2817.000=12.000
max2829.000-2817.000=12.000
mean2.789-2.818=-0.029
σ0.006-0.026=-0.020
min2.783-2.783=-0.000
max2.796-2.843=-0.047
policies=200
mean17721.170-17720.994=0.177
σ0.475-0.612=-0.137
min17720.839-17720.653=0.186
max17721.874-17721.911=-0.037
mean8400.000
σ0.000
min8400.000
max8400.000
mean2829.000-2817.000=12.000
σ0.000
min2829.000-2817.000=12.000
max2829.000-2817.000=12.000
mean27.861-27.594=0.267
σ0.412-0.119=0.292
min27.356-27.439=-0.083
max28.255-27.703=0.552