Compare commits

Home / Compare d78fb659 .. 81a599e6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.768-30.770=-0.001
σ0.048-0.049=-0.001
min30.730-30.729=0.001
max30.902-30.903=-0.002
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.076-0.076=0.000
σ0.003-0.005=-0.001
min0.070-0.071=-0.001
max0.083-0.086=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=0.000
σ0.002-0.002=-0.000
min21.058-21.057=0.001
max21.064-21.062=0.002
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.063-0.060=0.003
σ0.002-0.003=-0.001
min0.062-0.058=0.004
max0.069-0.066=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.419-1751.422=-0.003
σ0.362-0.362=-0.000
min1750.852-1750.850=0.002
max1752.004-1752.021=-0.017
mean1651.850-1650.750=1.100
σ624.959-621.992=2.966
min683.000-682.000=1.000
max2651.000-2649.000=2.000
mean2.824-2.819=0.005
σ0.129-0.179=-0.050
min2.450-2.311=0.138
max3.093-3.108=-0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.755-275.753=0.002
σ0.009-0.007=0.002
min275.746-275.746=0.001
max275.766-275.764=0.001
mean2651.000-2649.000=2.000
σ0.000
min2651.000-2649.000=2.000
max2651.000-2649.000=2.000
mean0.402-0.405=-0.003
σ0.007-0.010=-0.003
min0.396-0.396=0.001
max0.411-0.421=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2168.288-2168.282=0.006
σ0.006-0.010=-0.004
min2168.281-2168.272=0.009
max2168.295-2168.294=0.001
mean2651.000-2649.000=2.000
σ0.000
min2651.000-2649.000=2.000
max2651.000-2649.000=2.000
mean2.966-2.906=0.060
σ0.140-0.113=0.027
min2.810-2.741=0.069
max3.128-3.027=0.101
iters=5
new-facts=6402
prior-facts=1
mean5048.108-5048.092=0.016
σ0.916-0.928=-0.013
min5047.577-5047.586=-0.009
max5049.739-5049.747=-0.008
mean2651.000-2649.000=2.000
σ0.000
min2651.000-2649.000=2.000
max2651.000-2649.000=2.000
mean8.863-8.938=-0.076
σ0.504-0.471=0.032
min8.104-8.134=-0.031
max9.384-9.317=0.068
iters=5
new-facts=6402
prior-facts=6402
mean5179.247-5179.238=0.009
σ0.061-0.081=-0.020
min5179.191-5179.165=0.026
max5179.314-5179.338=-0.024
mean3238.000-3274.000=-36.000
σ395.686-380.699=14.987
min2699.000-2736.000=-37.000
max3744.000-3733.000=11.000
mean10.032-9.916=0.116
σ0.300-0.328=-0.028
min9.693-9.560=0.133
max10.395-10.205=0.190

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.194-1.212=-0.018
σ0.385-0.432=-0.047
min0.950-0.950=-0.000
max1.837-1.947=-0.110

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.573-463.572=0.001
σ572.663-572.663=-0.000
min177.237-177.237=-0.000
max1322.567-1322.566=0.001
mean79.750
σ7.500
min76.000
max91.000
mean2651.000-2649.000=2.000
σ0.000
min2651.000-2649.000=2.000
max2651.000-2649.000=2.000
mean0.554-0.558=-0.004
σ0.551-0.562=-0.011
min0.276-0.274=0.002
max1.381-1.401=-0.020
policies=20
mean1772.647-1772.636=0.011
σ0.337-0.333=0.004
min1772.424-1772.424=-0.000
max1773.147-1773.132=0.015
mean760.000
σ0.000
min760.000
max760.000
mean2651.000-2649.000=2.000
σ0.000
min2651.000-2649.000=2.000
max2651.000-2649.000=2.000
mean2.763-2.753=0.010
σ0.019-0.022=-0.002
min2.749-2.737=0.012
max2.791-2.784=0.007
policies=200
mean17732.985-17733.060=-0.076
σ0.345-0.518=-0.173
min17732.780-17732.789=-0.009
max17733.500-17733.837=-0.337
mean7600.000
σ0.000
min7600.000
max7600.000
mean2651.000-2649.000=2.000
σ0.000
min2651.000-2649.000=2.000
max2651.000-2649.000=2.000
mean27.760-27.797=-0.037
σ0.099-0.138=-0.039
min27.690-27.669=0.020
max27.900-27.957=-0.057