Compare commits

Home / Compare e71ee0bb .. 3d9d9ca3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.701=-0.135
σ0.043-0.045=-0.001
min70.540-70.676=-0.136
max70.685-70.823=-0.137
mean412.700-424.000=-11.300
σ0.483-0.000=0.483
min412.000-424.000=-12.000
max413.000-424.000=-11.000
mean0.157-0.160=-0.003
σ0.003-0.003=0.001
min0.155-0.158=-0.003
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.287-21.421=-0.134
σ0.002-0.003=-0.001
min21.283-21.417=-0.133
max21.290-21.426=-0.136
mean413.000-424.000=-11.000
σ0.000
min413.000-424.000=-11.000
max413.000-424.000=-11.000
mean0.062-0.066=-0.005
σ0.003-0.003=-0.000
min0.058-0.064=-0.005
max0.067-0.074=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1754.461=-0.892
σ0.359-0.361=-0.002
min1753.001-1753.885=-0.884
max1754.159-1755.041=-0.882
mean1652.850-1681.000=-28.150
σ645.434-649.469=-4.034
min641.000-634.000=7.000
max2886.000-2874.000=12.000
mean2.826-2.842=-0.016
σ0.152-0.125=0.026
min2.476-2.508=-0.032
max3.182-3.033=0.149

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.011-273.504=-1.492
σ0.012-0.006=0.005
min271.995-273.493=-1.498
max272.022-273.510=-1.488
mean2886.000-2874.000=12.000
σ0.000
min2886.000-2874.000=12.000
max2886.000-2874.000=12.000
mean0.390-0.377=0.013
σ0.006-0.009=-0.003
min0.384-0.372=0.012
max0.396-0.392=0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.447-1933.899=-1.452
σ0.019-0.011=0.008
min1932.425-1933.881=-1.456
max1932.473-1933.911=-1.438
mean2886.000-2874.000=12.000
σ0.000
min2886.000-2874.000=12.000
max2886.000-2874.000=12.000
mean2.872-2.929=-0.058
σ0.271-0.182=0.089
min2.424-2.738=-0.315
max3.088-3.152=-0.064
iters=5
new-facts=6402
prior-facts=1
mean4753.142-4754.483=-1.341
σ0.923-0.971=-0.048
min4752.667-4753.846=-1.178
max4754.787-4756.178=-1.392
mean2886.000-2874.000=12.000
σ0.000
min2886.000-2874.000=12.000
max2886.000-2874.000=12.000
mean8.820-8.399=0.421
σ0.291-0.508=-0.217
min8.478-7.740=0.738
max9.155-8.867=0.288
iters=5
new-facts=6402
prior-facts=6402
mean4943.555-4945.047=-1.492
σ0.165-0.162=0.003
min4943.261-4944.757=-1.496
max4943.646-4945.128=-1.482
mean3067.400-3083.000=-15.600
σ181.333-284.981=-103.647
min2886.000-2874.000=12.000
max3309.000-3530.000=-221.000
mean8.664-8.488=0.175
σ0.273-0.139=0.133
min8.404-8.367=0.036
max9.016-8.674=0.342

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.050-1.107=-0.056
σ0.185-0.141=0.044
min0.933-0.924=0.009
max1.364-1.252=0.112

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.082-473.078=0.004
σ575.913-575.924=-0.011
min185.118-185.112=0.006
max1336.951-1336.964=-0.013
mean88.250
σ8.500
min84.000
max101.000
mean2886.000-2874.000=12.000
σ0.000
min2886.000-2874.000=12.000
max2886.000-2874.000=12.000
mean0.446-0.488=-0.042
σ0.295-0.382=-0.086
min0.294-0.293=0.001
max0.889-1.061=-0.171
policies=20
mean1851.467-1851.445=0.022
σ0.380-0.375=0.005
min1851.178-1851.165=0.013
max1852.019-1851.991=0.029
mean840.000
σ0.000
min840.000
max840.000
mean2886.000-2874.000=12.000
σ0.000
min2886.000-2874.000=12.000
max2886.000-2874.000=12.000
mean2.942-2.941=0.001
σ0.008-0.009=-0.001
min2.931-2.928=0.002
max2.949-2.950=-0.001
policies=200
mean18521.104-18519.739=1.365
σ0.596-0.801=-0.205
min18520.762-18518.910=1.851
max18521.995-18520.605=1.391
mean8400.000
σ0.000
min8400.000
max8400.000
mean2886.000-2874.000=12.000
σ0.000
min2886.000-2874.000=12.000
max2886.000-2874.000=12.000
mean29.329-29.023=0.306
σ0.403-0.549=-0.147
min28.833-28.633=0.199
max29.729-29.836=-0.107