Compare commits

Home / Compare b8b270ed .. 7983df67

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.568=-0.005
σ0.045-0.046=-0.001
min70.539-70.541=-0.002
max70.689-70.694=-0.005
mean415.000
σ0.000
min415.000
max415.000
mean0.159-0.162=-0.003
σ0.005-0.004=0.001
min0.149-0.157=-0.008
max0.165-0.170=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.287-21.287=-0.000
σ0.003-0.003=-0.000
min21.283-21.283=0.000
max21.291-21.291=0.000
mean415.000
σ0.000
min415.000
max415.000
mean0.065-0.063=0.001
σ0.002-0.003=-0.001
min0.064-0.058=0.005
max0.069-0.066=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.375=-0.001
σ0.361-0.359=0.002
min1752.805-1752.806=-0.001
max1753.979-1753.953=0.025
mean1667.900-1670.500=-2.600
σ642.581-646.104=-3.523
min620.000
max2826.000-2712.000=114.000
mean2.809-2.858=-0.049
σ0.139-0.207=-0.068
min2.397-2.294=0.103
max2.973-3.127=-0.155

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.753-271.756=-0.003
σ0.007-0.006=0.001
min271.743-271.749=-0.006
max271.761-271.764=-0.003
mean2826.000-2712.000=114.000
σ0.000
min2826.000-2712.000=114.000
max2826.000-2712.000=114.000
mean0.382-0.381=0.000
σ0.005-0.005=-0.001
min0.378-0.376=0.001
max0.390-0.389=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.177-1932.175=0.003
σ0.006-0.014=-0.007
min1932.169-1932.155=0.014
max1932.186-1932.192=-0.006
mean2826.000-2712.000=114.000
σ0.000
min2826.000-2712.000=114.000
max2826.000-2712.000=114.000
mean3.060-2.981=0.078
σ0.073-0.172=-0.099
min3.004-2.709=0.295
max3.140-3.165=-0.025
iters=5
new-facts=6402
prior-facts=1
mean4752.907-4752.796=0.111
σ0.854-1.019=-0.165
min4752.423-4751.943=0.480
max4754.425-4754.556=-0.131
mean2826.000-2712.000=114.000
σ0.000
min2826.000-2712.000=114.000
max2826.000-2712.000=114.000
mean8.486-8.572=-0.086
σ0.517-0.587=-0.070
min7.627-7.628=-0.001
max8.936-9.168=-0.231
iters=5
new-facts=6402
prior-facts=6402
mean4943.375-4943.301=0.075
σ0.014-0.155=-0.142
min4943.361-4943.024=0.337
max4943.391-4943.384=0.007
mean3059.400-2968.600=90.800
σ232.136-302.531=-70.394
min2826.000-2712.000=114.000
max3392.000-3417.000=-25.000
mean8.559-8.454=0.105
σ0.278-0.138=0.140
min8.341-8.332=0.009
max9.034-8.684=0.350

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.027-1.138=-0.111
σ0.132-0.165=-0.032
min0.941-0.932=0.009
max1.244-1.353=-0.109

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.858-467.860=-0.002
σ575.925-575.947=-0.022
min179.888-179.884=0.004
max1331.746-1331.781=-0.036
mean86.250
σ8.500
min82.000
max99.000
mean2826.000-2712.000=114.000
σ0.000
min2826.000-2712.000=114.000
max2826.000-2712.000=114.000
mean0.445-0.566=-0.122
σ0.303-0.566=-0.263
min0.292-0.281=0.011
max0.899-1.415=-0.517
policies=20
mean1799.161-1799.131=0.031
σ0.356-0.374=-0.017
min1798.912-1798.889=0.023
max1799.687-1799.687=0.000
mean820.000
σ0.000
min820.000
max820.000
mean2826.000-2712.000=114.000
σ0.000
min2826.000-2712.000=114.000
max2826.000-2712.000=114.000
mean2.882-2.800=0.082
σ0.129-0.015=0.113
min2.783-2.785=-0.002
max3.063-2.818=0.245
policies=200
mean17998.408-17998.391=0.018
σ0.433-0.550=-0.117
min17998.007-17998.038=-0.032
max17999.023-17999.198=-0.175
mean8200.000
σ0.000
min8200.000
max8200.000
mean2826.000-2712.000=114.000
σ0.000
min2826.000-2712.000=114.000
max2826.000-2712.000=114.000
mean28.129-28.094=0.035
σ0.168-0.067=0.101
min28.003-28.035=-0.033
max28.373-28.171=0.201