Compare commits

Home / Compare a5573f56 .. 19c830d0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.619-35.618=0.001
σ0.054-0.055=-0.002
min35.584-35.585=-0.001
max35.769-35.774=-0.005
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.086-0.084=0.001
σ0.003-0.005=-0.002
min0.083-0.076=0.007
max0.092-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean24.046-24.047=-0.001
σ0.004-0.003=0.001
min24.040-24.043=-0.003
max24.054-24.052=0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.066-0.069=-0.004
σ0.008-0.003=0.004
min0.054-0.067=-0.013
max0.077-0.077=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.492-1756.492=0.000
σ0.366-0.365=0.001
min1755.915-1755.916=-0.001
max1757.077-1757.081=-0.004
mean1638.650-1638.450=0.200
σ604.461-604.458=0.003
min658.000
max2450.000-2449.000=1.000
mean2.324-2.352=-0.028
σ0.135-0.108=0.027
min2.057-2.189=-0.133
max2.714-2.626=0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.760-324.762=-0.002
σ0.048-0.053=-0.004
min324.674-324.669=0.005
max324.789-324.795=-0.005
mean2450.000-2449.000=1.000
σ0.000
min2450.000-2449.000=1.000
max2450.000-2449.000=1.000
mean0.426-0.426=0.001
σ0.002-0.001=0.001
min0.424-0.425=-0.001
max0.429-0.428=0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.325-1985.317=0.008
σ0.008-0.015=-0.007
min1985.316-1985.295=0.021
max1985.335-1985.337=-0.002
mean2450.000-2449.000=1.000
σ0.000
min2450.000-2449.000=1.000
max2450.000-2449.000=1.000
mean2.606-2.601=0.005
σ0.109-0.103=0.006
min2.504-2.490=0.014
max2.739-2.719=0.020
iters=5
new-facts=6402
prior-facts=1
mean4809.085-4808.973=0.112
σ7.670-7.733=-0.063
min4805.542-4804.998=0.544
max4822.804-4822.795=0.009
mean2450.000-2449.000=1.000
σ0.000
min2450.000-2449.000=1.000
max2450.000-2449.000=1.000
mean8.676-8.804=-0.128
σ0.396-0.186=0.210
min8.169-8.603=-0.434
max9.148-9.005=0.143
iters=5
new-facts=6402
prior-facts=6402
mean4996.631-4996.561=0.070
σ0.020-0.150=-0.130
min4996.606-4996.296=0.310
max4996.651-4996.649=0.002
mean3015.400-2964.800=50.600
σ283.473-282.034=1.439
min2611.000-2579.000=32.000
max3372.000-3297.000=75.000
mean8.659-8.628=0.031
σ0.156-0.185=-0.029
min8.472-8.450=0.022
max8.860-8.941=-0.081

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.688-1.719=-0.031
σ0.265-0.187=0.078
min1.218-1.407=-0.189
max1.860-1.883=-0.023

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.204-463.202=0.001
σ574.766-574.764=0.001
min175.818-175.816=0.003
max1325.352-1325.349=0.003
mean86.250
σ8.500
min82.000
max99.000
mean2450.000-2449.000=1.000
σ0.000
min2450.000-2449.000=1.000
max2450.000-2449.000=1.000
mean0.537-0.544=-0.007
σ0.525-0.541=-0.016
min0.273-0.267=0.005
max1.325-1.356=-0.031
policies=20
mean1758.465-1758.485=-0.021
σ0.362-0.346=0.016
min1758.239-1758.260=-0.021
max1759.004-1758.999=0.005
mean820.000
σ0.000
min820.000
max820.000
mean2450.000-2449.000=1.000
σ0.000
min2450.000-2449.000=1.000
max2450.000-2449.000=1.000
mean2.727-2.728=-0.001
σ0.018-0.014=0.003
min2.713-2.715=-0.002
max2.752-2.747=0.005
policies=200
mean17591.917-17592.114=-0.197
σ0.502-0.520=-0.018
min17591.631-17591.809=-0.178
max17592.670-17592.891=-0.221
mean8200.000
σ0.000
min8200.000
max8200.000
mean2450.000-2449.000=1.000
σ0.000
min2450.000-2449.000=1.000
max2450.000-2449.000=1.000
mean27.554-27.643=-0.090
σ0.146-0.183=-0.037
min27.407-27.483=-0.076
max27.701-27.870=-0.169