Compare commits

Home / Compare 4a943a33 .. 06c80e07

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.655-53.655=0.000
σ0.371-0.370=0.002
min53.509-53.517=-0.007
max54.711-54.706=0.005
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.137-0.137=0.001
σ0.004-0.003=0.002
min0.131-0.134=-0.003
max0.145-0.141=0.003
cache=y
dps=1
iters=10
policies=100
mean42.981-42.980=0.002
σ0.005-0.007=-0.001
min42.974-42.970=0.004
max42.988-42.992=-0.003
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.122-0.119=0.003
σ0.005-0.005=0.001
min0.118-0.115=0.003
max0.134-0.126=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.696-1013.694=0.002
σ1.223-1.213=0.009
min1013.134-1013.163=-0.029
max1018.811-1018.776=0.035
mean1047.500-1060.950=-13.450
σ315.385-316.357=-0.972
min608.000-595.000=13.000
max1650.000-1638.000=12.000
mean1.654-1.622=0.032
σ0.116-0.096=0.020
min1.502-1.523=-0.021
max1.916-1.871=0.045

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean334.437-334.291=0.146
σ0.223-0.202=0.022
min334.181-334.103=0.078
max335.024-334.825=0.199
mean2122.000-2111.000=11.000
σ0.000
min2122.000-2111.000=11.000
max2122.000-2111.000=11.000
mean0.731-0.774=-0.043
σ0.024-0.066=-0.043
min0.692-0.688=0.004
max0.759-0.849=-0.090

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.410-294.415=-0.005
σ0.019-0.018=0.001
min294.386-294.393=-0.007
max294.437-294.440=-0.002
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean0.389-0.390=-0.002
σ0.009-0.009=0.000
min0.381-0.383=-0.002
max0.403-0.401=0.003
iters=5
new-facts=1
prior-facts=6402
mean1316.722-1316.696=0.026
σ0.064-0.077=-0.013
min1316.612-1316.565=0.047
max1316.777-1316.771=0.007
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean1.898-1.894=0.005
σ0.040-0.080=-0.040
min1.854-1.827=0.027
max1.949-2.029=-0.080
iters=5
new-facts=6402
prior-facts=1
mean1736.955-1736.943=0.012
σ6.910-6.906=0.004
min1733.698-1733.696=0.002
max1749.311-1749.292=0.019
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean3.052-3.067=-0.015
σ0.398-0.360=0.038
min2.600-2.624=-0.024
max3.588-3.506=0.082
iters=5
new-facts=6402
prior-facts=6402
mean1999.636-1999.669=-0.033
σ0.025-0.018=0.008
min1999.602-1999.642=-0.040
max1999.660-1999.687=-0.027
mean1843.600-1868.600=-25.000
σ198.888-193.833=5.054
min1650.000-1638.000=12.000
max2122.000-2111.000=11.000
mean3.225-3.343=-0.118
σ0.051-0.096=-0.045
min3.167-3.257=-0.090
max3.300-3.495=-0.195

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.086-1.172=-0.086
σ0.159-0.206=-0.047
min0.901-0.918=-0.018
max1.279-1.463=-0.183

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean441.084-441.092=-0.009
σ573.019-573.035=-0.015
min154.568-154.568=-0.000
max1300.613-1300.644=-0.031
mean94.250
σ8.500
min90.000
max107.000
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean0.547-0.563=-0.016
σ0.559-0.599=-0.039
min0.263-0.258=0.004
max1.386-1.461=-0.075
policies=20
mean1545.922-1545.913=0.009
σ0.336-0.328=0.008
min1545.725-1545.716=0.010
max1546.425-1546.403=0.022
mean900.000
σ0.000
min900.000
max900.000
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean2.639-2.618=0.021
σ0.022-0.012=0.010
min2.620-2.608=0.012
max2.668-2.634=0.034
policies=200
mean15467.054-15467.112=-0.058
σ0.086-0.061=0.025
min15466.963-15467.043=-0.080
max15467.133-15467.188=-0.054
mean9000.000
σ0.000
min9000.000
max9000.000
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean26.870-26.605=0.265
σ0.168-0.160=0.008
min26.712-26.447=0.264
max27.089-26.820=0.269