Compare commits

Home / Compare e453cc2a .. b5a6eb29

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.782=-0.000
σ0.046-0.045=0.001
min70.748-70.753=-0.005
max70.910-70.907=0.003
mean413.900-413.000=0.900
σ0.316-0.000=0.316
min413.000
max414.000-413.000=1.000
mean0.160-0.162=-0.002
σ0.003-0.005=-0.002
min0.157-0.158=-0.001
max0.165-0.172=-0.007
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.000
σ0.003-0.003=-0.000
min21.487-21.488=-0.001
max21.497-21.496=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.063-0.065=-0.002
σ0.003-0.003=0.001
min0.059-0.063=-0.004
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.094=0.001
σ0.358-0.358=-0.000
min1753.534-1753.534=0.001
max1754.675-1754.658=0.017
mean1663.600-1628.850=34.750
σ636.478-595.164=41.314
min625.000-642.000=-17.000
max2780.000-2423.000=357.000
mean2.803-2.812=-0.010
σ0.146-0.115=0.032
min2.441-2.481=-0.040
max3.085-2.949=0.136

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.953-271.955=-0.002
σ0.004-0.005=-0.001
min271.949-271.950=-0.001
max271.959-271.961=-0.002
mean2780.000-2423.000=357.000
σ0.000
min2780.000-2423.000=357.000
max2780.000-2423.000=357.000
mean0.383-0.379=0.004
σ0.008-0.001=0.007
min0.377-0.378=-0.000
max0.396-0.380=0.016
iters=5
new-facts=1
prior-facts=6402
mean1932.329-1932.327=0.002
σ0.015-0.019=-0.005
min1932.313-1932.309=0.004
max1932.353-1932.359=-0.007
mean2780.000-2423.000=357.000
σ0.000
min2780.000-2423.000=357.000
max2780.000-2423.000=357.000
mean2.968-2.927=0.041
σ0.191-0.254=-0.063
min2.657-2.483=0.174
max3.182-3.114=0.067
iters=5
new-facts=6402
prior-facts=1
mean4753.107-4753.080=0.027
σ0.894-0.909=-0.014
min4752.570-4752.585=-0.016
max4754.688-4754.693=-0.005
mean2780.000-2423.000=357.000
σ0.000
min2780.000-2423.000=357.000
max2780.000-2423.000=357.000
mean8.411-8.647=-0.237
σ0.541-0.449=0.092
min7.701-7.938=-0.237
max8.931-9.012=-0.081
iters=5
new-facts=6402
prior-facts=6402
mean4943.492-4943.487=0.005
σ0.147-0.155=-0.008
min4943.229-4943.211=0.018
max4943.562-4943.575=-0.013
mean3024.200-2964.600=59.600
σ227.928-249.500=-21.572
min2780.000-2645.000=135.000
max3330.000-3299.000=31.000
mean8.615-8.483=0.132
σ0.230-0.060=0.170
min8.411-8.405=0.006
max8.879-8.546=0.332

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.986-1.825=-0.839
σ0.117-0.115=0.002
min0.926-1.626=-0.700
max1.194-1.909=-0.715

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.660-468.651=0.010
σ574.932-574.923=0.010
min181.188-181.188=0.001
max1331.059-1331.035=0.024
mean88.250
σ8.500
min84.000
max101.000
mean2780.000-2423.000=357.000
σ0.000
min2780.000-2423.000=357.000
max2780.000-2423.000=357.000
mean0.443-0.555=-0.112
σ0.300-0.534=-0.235
min0.292-0.285=0.007
max0.892-1.356=-0.464
policies=20
mean1812.215-1812.207=0.009
σ0.371-0.387=-0.016
min1811.938-1811.953=-0.016
max1812.747-1812.779=-0.032
mean840.000
σ0.000
min840.000
max840.000
mean2780.000-2423.000=357.000
σ0.000
min2780.000-2423.000=357.000
max2780.000-2423.000=357.000
mean2.937-2.839=0.099
σ0.107-0.012=0.095
min2.836-2.824=0.012
max3.088-2.853=0.236
policies=200
mean18129.078-18129.261=-0.182
σ0.391-0.456=-0.066
min18128.679-18128.928=-0.249
max18129.615-18129.935=-0.320
mean8400.000
σ0.000
min8400.000
max8400.000
mean2780.000-2423.000=357.000
σ0.000
min2780.000-2423.000=357.000
max2780.000-2423.000=357.000
mean28.627-28.553=0.074
σ0.080-0.110=-0.031
min28.550-28.433=0.117
max28.739-28.662=0.076