Compare commits

Home / Compare bc9bf6ec .. 271c9f3f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.244=0.374
σ0.055-0.054=0.001
min35.585-35.207=0.378
max35.774-35.395=0.378
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.084-0.085=-0.001
σ0.005-0.003=0.002
min0.076-0.082=-0.006
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean24.047-23.768=0.280
σ0.003-0.003=-0.000
min24.043-23.764=0.279
max24.052-23.774=0.279
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.069-0.063=0.006
σ0.003-0.004=-0.001
min0.067-0.060=0.007
max0.077-0.072=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.492-1756.349=0.142
σ0.365-0.367=-0.002
min1755.916-1755.770=0.145
max1757.081-1756.941=0.141
mean1638.450-1643.650=-5.200
σ604.458-629.437=-24.980
min658.000-654.000=4.000
max2449.000-2839.000=-390.000
mean2.352-2.329=0.023
σ0.108-0.091=0.017
min2.189-2.219=-0.030
max2.626-2.634=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.572=0.190
σ0.053-0.042=0.011
min324.669-324.497=0.171
max324.795-324.596=0.198
mean2449.000-2839.000=-390.000
σ0.000
min2449.000-2839.000=-390.000
max2449.000-2839.000=-390.000
mean0.426-0.422=0.004
σ0.001-0.001=0.000
min0.425-0.421=0.004
max0.428-0.424=0.004
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.131=0.185
σ0.015-0.010=0.005
min1985.295-1985.116=0.179
max1985.337-1985.145=0.193
mean2449.000-2839.000=-390.000
σ0.000
min2449.000-2839.000=-390.000
max2449.000-2839.000=-390.000
mean2.601-2.613=-0.012
σ0.103-0.081=0.022
min2.490-2.554=-0.064
max2.719-2.739=-0.019
iters=5
new-facts=6402
prior-facts=1
mean4808.973-4808.735=0.238
σ7.733-7.662=0.070
min4804.998-4805.263=-0.265
max4822.795-4822.442=0.353
mean2449.000-2839.000=-390.000
σ0.000
min2449.000-2839.000=-390.000
max2449.000-2839.000=-390.000
mean8.804-8.908=-0.105
σ0.186-0.414=-0.227
min8.603-8.380=0.223
max9.005-9.520=-0.515
iters=5
new-facts=6402
prior-facts=6402
mean4996.561-4996.316=0.245
σ0.150-0.029=0.121
min4996.296-4996.270=0.026
max4996.649-4996.342=0.307
mean2964.800-3067.600=-102.800
σ282.034-302.299=-20.265
min2579.000-2839.000=-260.000
max3297.000-3537.000=-240.000
mean8.628-8.508=0.120
σ0.185-0.162=0.023
min8.450-8.374=0.076
max8.941-8.758=0.183

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.719-1.005=0.714
σ0.187-0.137=0.050
min1.407-0.913=0.494
max1.883-1.230=0.653

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.202-462.952=0.251
σ574.764-574.254=0.511
min175.816-175.812=0.004
max1325.349-1324.332=1.017
mean86.250
σ8.500
min82.000
max99.000
mean2449.000-2839.000=-390.000
σ0.000
min2449.000-2839.000=-390.000
max2449.000-2839.000=-390.000
mean0.544-0.429=0.115
σ0.541-0.288=0.253
min0.267-0.283=-0.016
max1.356-0.861=0.495
policies=20
mean1758.485-1758.473=0.012
σ0.346-0.344=0.001
min1758.260-1758.225=0.035
max1758.999-1758.978=0.021
mean820.000
σ0.000
min820.000
max820.000
mean2449.000-2839.000=-390.000
σ0.000
min2449.000-2839.000=-390.000
max2449.000-2839.000=-390.000
mean2.728-2.813=-0.085
σ0.014-0.024=-0.010
min2.715-2.780=-0.065
max2.747-2.830=-0.083
policies=200
mean17592.114-17590.693=1.422
σ0.520-0.583=-0.063
min17591.809-17589.972=1.837
max17592.891-17591.369=1.522
mean8200.000
σ0.000
min8200.000
max8200.000
mean2449.000-2839.000=-390.000
σ0.000
min2449.000-2839.000=-390.000
max2449.000-2839.000=-390.000
mean27.643-27.904=-0.261
σ0.183-0.356=-0.173
min27.483-27.603=-0.119
max27.870-28.366=-0.496