Compare commits

Home / Compare ef3825b7 .. 4407df86

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.799=-0.000
σ0.106-0.106=-0.000
min35.749-35.753=-0.004
max36.099-36.099=-0.000
mean415.900-416.000=-0.100
σ0.316-0.000=0.316
min415.000-416.000=-1.000
max416.000
mean0.076-0.074=0.002
σ0.004-0.005=-0.001
min0.073-0.068=0.005
max0.083-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.002
σ0.003-0.003=-0.001
min26.059-26.058=0.001
max26.067-26.069=-0.002
mean416.000
σ0.000
min416.000
max416.000
mean0.061-0.061=0.000
σ0.003-0.003=0.000
min0.060-0.059=0.000
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.923=0.000
σ0.367-0.364=0.003
min1755.351-1755.350=0.001
max1756.517-1756.514=0.003
mean1665.350-1666.500=-1.150
σ633.333-627.505=5.829
min668.000-672.000=-4.000
max2624.000-2653.000=-29.000
mean2.787-2.770=0.017
σ0.155-0.170=-0.015
min2.269-2.351=-0.082
max2.973-3.056=-0.084

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.194-277.195=-0.001
σ0.006-0.007=-0.001
min277.185-277.183=0.002
max277.200-277.202=-0.002
mean2624.000-2653.000=-29.000
σ0.000
min2624.000-2653.000=-29.000
max2624.000-2653.000=-29.000
mean0.393-0.401=-0.008
σ0.002-0.002=-0.000
min0.392-0.398=-0.006
max0.396-0.402=-0.006
iters=5
new-facts=1
prior-facts=6402
mean2174.435-2174.439=-0.004
σ0.006-0.016=-0.011
min2174.429-2174.427=0.002
max2174.442-2174.464=-0.023
mean2624.000-2653.000=-29.000
σ0.000
min2624.000-2653.000=-29.000
max2624.000-2653.000=-29.000
mean2.957-2.993=-0.036
σ0.173-0.193=-0.021
min2.721-2.673=0.047
max3.187-3.197=-0.010
iters=5
new-facts=6402
prior-facts=1
mean5052.508-5052.365=0.143
σ1.065-1.247=-0.181
min5051.575-5050.921=0.654
max5054.336-5054.363=-0.027
mean2624.000-2653.000=-29.000
σ0.000
min2624.000-2653.000=-29.000
max2624.000-2653.000=-29.000
mean9.265-9.218=0.047
σ0.687-0.288=0.399
min8.262-8.918=-0.656
max10.055-9.654=0.402
iters=5
new-facts=6402
prior-facts=6402
mean5188.358-5188.427=-0.069
σ0.210-0.090=0.121
min5188.008-5188.357=-0.349
max5188.526-5188.530=-0.004
mean3229.200-3233.400=-4.200
σ386.322-388.477=-2.155
min2670.000-2675.000=-5.000
max3692.000-3697.000=-5.000
mean9.015-8.966=0.048
σ0.448-0.354=0.093
min8.628-8.723=-0.095
max9.713-9.577=0.136

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.282-1.245=0.037
σ0.348-0.341=0.007
min0.946-0.950=-0.004
max1.705-1.808=-0.103

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.857-464.860=-0.003
σ572.656-572.660=-0.004
min178.523-178.522=0.000
max1323.841-1323.850=-0.009
mean79.500
σ7.000
min76.000
max90.000
mean2624.000-2653.000=-29.000
σ0.000
min2624.000-2653.000=-29.000
max2624.000-2653.000=-29.000
mean0.548-0.566=-0.018
σ0.535-0.566=-0.031
min0.277-0.281=-0.004
max1.350-1.415=-0.066
policies=20
mean1785.482-1785.481=0.001
σ0.348-0.335=0.013
min1785.254-1785.255=-0.001
max1785.999-1785.978=0.021
mean760.000
σ0.000
min760.000
max760.000
mean2624.000-2653.000=-29.000
σ0.000
min2624.000-2653.000=-29.000
max2624.000-2653.000=-29.000
mean2.780-2.784=-0.004
σ0.005-0.009=-0.004
min2.776-2.771=0.005
max2.788-2.791=-0.003
policies=200
mean17861.487-17861.530=-0.043
σ0.357-0.506=-0.149
min17861.282-17861.227=0.055
max17862.022-17862.286=-0.264
mean7600.000
σ0.000
min7600.000
max7600.000
mean2624.000-2653.000=-29.000
σ0.000
min2624.000-2653.000=-29.000
max2624.000-2653.000=-29.000
mean28.106-28.112=-0.007
σ0.128-0.185=-0.058
min27.979-27.911=0.068
max28.230-28.279=-0.048