Compare commits

Home / Compare 42f9230b .. 22b950c4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=-0.000
σ0.049-0.045=0.003
min33.953-33.952=0.001
max34.114-34.104=0.010
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.085-0.084=0.000
σ0.004-0.004=0.000
min0.082-0.081=0.000
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.002-0.002=0.000
min23.314-23.315=-0.001
max23.322-23.323=-0.000
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.000
min0.064-0.064=-0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.431-1757.428=0.003
σ0.364-0.364=-0.001
min1756.857-1756.856=0.001
max1758.016-1758.020=-0.004
mean1667.400-1677.800=-10.400
σ627.415-636.007=-8.592
min671.000-665.000=6.000
max2616.000-2646.000=-30.000
mean2.376-2.376=0.000
σ0.123-0.120=0.003
min2.263-2.234=0.029
max2.728-2.750=-0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.578-326.577=0.002
σ0.031-0.037=-0.006
min326.525-326.512=0.013
max326.600-326.600=-0.000
mean2616.000-2646.000=-30.000
σ0.000
min2616.000-2646.000=-30.000
max2616.000-2646.000=-30.000
mean0.429-0.425=0.004
σ0.004-0.002=0.002
min0.424-0.422=0.001
max0.433-0.427=0.006
iters=5
new-facts=1
prior-facts=6402
mean1988.731-1988.724=0.007
σ0.012-0.023=-0.011
min1988.715-1988.694=0.022
max1988.744-1988.748=-0.003
mean2616.000-2646.000=-30.000
σ0.000
min2616.000-2646.000=-30.000
max2616.000-2646.000=-30.000
mean2.652-2.777=-0.125
σ0.047-0.120=-0.073
min2.586-2.618=-0.032
max2.713-2.910=-0.197
iters=5
new-facts=6402
prior-facts=1
mean4813.572-4672.733=140.839
σ7.741-316.453=-308.713
min4810.088-4106.794=703.294
max4827.419-4826.852=0.566
mean2616.000-2646.000=-30.000
σ0.000
min2616.000-2646.000=-30.000
max2616.000-2646.000=-30.000
mean8.868-8.349=0.518
σ0.282-0.856=-0.574
min8.488-7.063=1.425
max9.231-9.189=0.041
iters=5
new-facts=6402
prior-facts=6402
mean5001.138-5001.092=0.046
σ0.025-0.159=-0.134
min5001.114-5000.811=0.303
max5001.174-5001.203=-0.029
mean2979.400-3016.000=-36.600
σ276.702-369.123=-92.421
min2616.000-2646.000=-30.000
max3317.000-3503.000=-186.000
mean9.728-10.191=-0.463
σ0.222-0.274=-0.051
min9.374-9.946=-0.572
max9.946-10.620=-0.674

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.364-1.137=0.228
σ0.333-0.311=0.022
min0.914-0.907=0.007
max1.776-1.670=0.106

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.563-464.568=-0.005
σ574.778-574.776=0.002
min177.171-177.172=-0.001
max1326.731-1326.732=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2616.000-2646.000=-30.000
σ0.000
min2616.000-2646.000=-30.000
max2616.000-2646.000=-30.000
mean0.547-0.528=0.018
σ0.544-0.509=0.034
min0.271-0.271=-0.000
max1.362-1.292=0.070
policies=20
mean1772.038-1772.050=-0.012
σ0.356-0.354=0.001
min1771.802-1771.813=-0.011
max1772.565-1772.575=-0.010
mean840.000
σ0.000
min840.000
max840.000
mean2616.000-2646.000=-30.000
σ0.000
min2616.000-2646.000=-30.000
max2616.000-2646.000=-30.000
mean2.730-2.734=-0.004
σ0.018-0.013=0.004
min2.713-2.722=-0.009
max2.748-2.753=-0.005
policies=200
mean17727.574-17727.611=-0.037
σ0.329-0.472=-0.142
min17727.406-17727.356=0.050
max17728.068-17728.318=-0.249
mean8400.000
σ0.000
min8400.000
max8400.000
mean2616.000-2646.000=-30.000
σ0.000
min2616.000-2646.000=-30.000
max2616.000-2646.000=-30.000
mean27.518-27.481=0.037
σ0.112-0.166=-0.054
min27.410-27.335=0.075
max27.645-27.636=0.009