Compare commits

Home / Compare a50ad321 .. 1a9dcd12

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.957-30.958=-0.001
σ0.049-0.049=-0.000
min30.920-30.915=0.005
max31.094-31.094=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.074-0.079=-0.005
σ0.005-0.003=0.002
min0.069-0.075=-0.006
max0.081-0.084=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=0.001
σ0.002-0.002=-0.000
min21.058-21.056=0.002
max21.064-21.062=0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.064-0.064=-0.000
σ0.003-0.002=0.000
min0.062-0.062=-0.000
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.413=-0.001
σ0.363-0.361=0.002
min1750.841-1750.846=-0.005
max1751.993-1751.988=0.005
mean1641.450-1654.900=-13.450
σ619.012-617.272=1.739
min652.000-637.000=15.000
max2478.000-2494.000=-16.000
mean2.768-2.843=-0.075
σ0.196-0.124=0.072
min2.261-2.604=-0.343
max3.039-3.195=-0.157

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.404-273.404=-0.000
σ0.012-0.010=0.002
min273.392-273.395=-0.003
max273.420-273.419=0.002
mean2478.000-2494.000=-16.000
σ0.000
min2478.000-2494.000=-16.000
max2478.000-2494.000=-16.000
mean0.386-0.383=0.003
σ0.010-0.009=0.001
min0.376-0.378=-0.003
max0.399-0.400=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.836-1933.842=-0.007
σ0.007-0.008=-0.001
min1933.825-1933.835=-0.010
max1933.844-1933.855=-0.011
mean2478.000-2494.000=-16.000
σ0.000
min2478.000-2494.000=-16.000
max2478.000-2494.000=-16.000
mean3.053-2.858=0.194
σ0.090-0.158=-0.068
min2.975-2.680=0.294
max3.177-2.992=0.185
iters=5
new-facts=6402
prior-facts=1
mean4754.403-4754.267=0.135
σ0.851-0.899=-0.049
min4753.922-4753.534=0.388
max4755.915-4755.835=0.079
mean2478.000-2494.000=-16.000
σ0.000
min2478.000-2494.000=-16.000
max2478.000-2494.000=-16.000
mean8.102-8.244=-0.142
σ0.574-0.638=-0.064
min7.632-7.604=0.028
max9.089-9.120=-0.031
iters=5
new-facts=6402
prior-facts=6402
mean4944.729-4944.667=0.063
σ0.123-0.195=-0.072
min4944.543-4944.404=0.140
max4944.890-4944.894=-0.004
mean2913.800-3012.400=-98.600
σ394.657-418.524=-23.867
min2478.000-2494.000=-16.000
max3452.000-3585.000=-133.000
mean8.399-8.716=-0.317
σ0.039-0.395=-0.355
min8.359-8.470=-0.111
max8.448-9.416=-0.968

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.791-1.711=0.080
σ0.112-0.146=-0.034
min1.602-1.454=0.148
max1.882-1.817=0.064

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.334-463.334=-0.001
σ572.193-572.197=-0.004
min177.234-177.233=0.001
max1321.623-1321.630=-0.007
mean79.750
σ7.500
min76.000
max91.000
mean2478.000-2494.000=-16.000
σ0.000
min2478.000-2494.000=-16.000
max2478.000-2494.000=-16.000
mean0.556-0.541=0.015
σ0.547-0.514=0.033
min0.276-0.281=-0.005
max1.376-1.312=0.064
policies=20
mean1772.587-1772.586=0.002
σ0.332-0.334=-0.002
min1772.368-1772.362=0.006
max1773.081-1773.081=-0.001
mean760.000
σ0.000
min760.000
max760.000
mean2478.000-2494.000=-16.000
σ0.000
min2478.000-2494.000=-16.000
max2478.000-2494.000=-16.000
mean2.747-2.735=0.012
σ0.024-0.007=0.018
min2.721-2.729=-0.008
max2.769-2.745=0.024
policies=200
mean17732.335-17732.382=-0.047
σ0.548-0.510=0.038
min17731.930-17731.999=-0.070
max17733.144-17733.123=0.021
mean7600.000
σ0.000
min7600.000
max7600.000
mean2478.000-2494.000=-16.000
σ0.000
min2478.000-2494.000=-16.000
max2478.000-2494.000=-16.000
mean27.604-27.592=0.012
σ0.115-0.073=0.042
min27.503-27.534=-0.031
max27.760-27.696=0.064