Compare commits

Home / Compare d4338c92 .. 3807e615

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.000
σ0.049-0.050=-0.002
min33.953-33.945=0.008
max34.114-34.116=-0.002
mean416.000
σ0.000
min416.000
max416.000
mean0.084-0.084=0.000
σ0.006-0.003=0.003
min0.078-0.082=-0.004
max0.094-0.089=0.005
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.003-0.003=-0.000
min23.313-23.314=-0.001
max23.323-23.324=-0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.065-0.066=-0.001
σ0.002-0.003=-0.001
min0.060-0.064=-0.004
max0.070-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1757.303=-0.000
σ0.363-0.365=-0.002
min1756.728-1756.729=-0.001
max1757.891-1757.893=-0.002
mean1664.050-1647.800=16.250
σ623.423-624.132=-0.708
min671.000-637.000=34.000
max2600.000-2826.000=-226.000
mean2.416-2.355=0.062
σ0.186-0.096=0.089
min2.251-2.258=-0.006
max2.931-2.622=0.308

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.437-326.458=-0.021
σ0.059-0.031=0.027
min326.332-326.405=-0.072
max326.475-326.484=-0.009
mean2600.000-2826.000=-226.000
σ0.000
min2600.000-2826.000=-226.000
max2600.000-2826.000=-226.000
mean0.423-0.427=-0.004
σ0.003-0.005=-0.002
min0.421-0.422=-0.001
max0.426-0.433=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.616-1988.612=0.003
σ0.006-0.011=-0.005
min1988.611-1988.598=0.013
max1988.625-1988.622=0.003
mean2600.000-2826.000=-226.000
σ0.000
min2600.000-2826.000=-226.000
max2600.000-2826.000=-226.000
mean2.680-2.716=-0.035
σ0.108-0.134=-0.026
min2.582-2.605=-0.023
max2.854-2.949=-0.094
iters=5
new-facts=6402
prior-facts=1
mean4813.450-4813.478=-0.029
σ7.727-7.725=0.002
min4809.941-4809.910=0.032
max4827.273-4827.295=-0.023
mean2600.000-2826.000=-226.000
σ0.000
min2600.000-2826.000=-226.000
max2600.000-2826.000=-226.000
mean8.855-8.564=0.291
σ0.318-0.597=-0.279
min8.437-7.694=0.743
max9.164-9.231=-0.067
iters=5
new-facts=6402
prior-facts=6402
mean5000.939-5001.009=-0.069
σ0.156-0.016=0.141
min5000.663-5000.988=-0.326
max5001.038-5001.024=0.013
mean2993.800-2998.600=-4.800
σ262.689-246.930=15.760
min2609.000-2826.000=-217.000
max3310.000-3399.000=-89.000
mean9.821-9.732=0.089
σ0.083-0.045=0.038
min9.722-9.659=0.063
max9.932-9.782=0.150

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.157-0.998=0.159
σ0.385-0.064=0.321
min0.923-0.916=0.007
max1.818-1.052=0.767

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.441-464.444=-0.003
σ574.782-574.770=0.012
min177.041-177.045=-0.004
max1326.614-1326.599=0.015
mean88.250
σ8.500
min84.000
max101.000
mean2600.000-2826.000=-226.000
σ0.000
min2600.000-2826.000=-226.000
max2600.000-2826.000=-226.000
mean0.545-0.438=0.107
σ0.540-0.307=0.233
min0.271-0.283=-0.011
max1.356-0.899=0.457
policies=20
mean1770.765-1770.804=-0.040
σ0.355-0.353=0.001
min1770.531-1770.554=-0.023
max1771.292-1771.324=-0.033
mean840.000
σ0.000
min840.000
max840.000
mean2600.000-2826.000=-226.000
σ0.000
min2600.000-2826.000=-226.000
max2600.000-2826.000=-226.000
mean2.734-2.816=-0.081
σ0.027-0.020=0.007
min2.705-2.798=-0.093
max2.760-2.843=-0.083
policies=200
mean17714.840-17714.871=-0.031
σ0.429-0.538=-0.110
min17714.575-17714.500=0.075
max17715.473-17715.671=-0.197
mean8400.000
σ0.000
min8400.000
max8400.000
mean2600.000-2826.000=-226.000
σ0.000
min2600.000-2826.000=-226.000
max2600.000-2826.000=-226.000
mean27.569-27.919=-0.350
σ0.155-0.370=-0.214
min27.413-27.604=-0.192
max27.759-28.335=-0.577