Compare commits

Home / Compare ee296939 .. b508de17

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.045-73.048=-0.004
σ0.046-0.049=-0.003
min73.011-73.023=-0.012
max73.173-73.189=-0.015
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.161-0.169=-0.008
σ0.003-0.011=-0.008
min0.155-0.157=-0.002
max0.166-0.185=-0.020
cache=y
dps=1
iters=10
policies=100
mean23.741-23.741=-0.001
σ0.004-0.003=0.001
min23.735-23.737=-0.002
max23.746-23.747=-0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.066-0.066=-0.001
σ0.003-0.002=0.001
min0.064-0.065=-0.000
max0.075-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.786-1758.789=-0.003
σ0.362-0.362=-0.000
min1758.217-1758.215=0.002
max1759.387-1759.370=0.018
mean1659.950-1626.450=33.500
σ625.608-599.033=26.575
min619.000-649.000=-30.000
max2844.000-2430.000=414.000
mean2.812-2.835=-0.023
σ0.229-0.206=0.023
min2.268-2.292=-0.024
max3.114-3.114=-0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.017-324.017=0.000
σ0.042-0.050=-0.008
min323.943-323.928=0.015
max324.043-324.051=-0.009
mean2844.000-2430.000=414.000
σ0.000
min2844.000-2430.000=414.000
max2844.000-2430.000=414.000
mean0.430-0.429=0.001
σ0.003-0.004=-0.001
min0.425-0.427=-0.001
max0.433-0.436=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1984.581-1984.586=-0.005
σ0.018-0.022=-0.004
min1984.563-1984.562=0.001
max1984.602-1984.611=-0.009
mean2844.000-2430.000=414.000
σ0.000
min2844.000-2430.000=414.000
max2844.000-2430.000=414.000
mean2.589-2.691=-0.103
σ0.050-0.167=-0.116
min2.521-2.561=-0.040
max2.653-2.889=-0.236
iters=5
new-facts=6402
prior-facts=1
mean4808.224-4808.118=0.106
σ7.787-7.835=-0.048
min4804.699-4804.150=0.549
max4822.154-4822.125=0.029
mean2844.000-2430.000=414.000
σ0.000
min2844.000-2430.000=414.000
max2844.000-2430.000=414.000
mean8.832-8.641=0.191
σ0.106-0.452=-0.347
min8.738-7.909=0.829
max9.009-9.128=-0.119
iters=5
new-facts=6402
prior-facts=6402
mean4995.800-4995.802=-0.002
σ0.023-0.018=0.005
min4995.779-4995.778=0.001
max4995.830-4995.819=0.011
mean3011.200-2919.600=91.600
σ242.289-329.784=-87.495
min2844.000-2430.000=414.000
max3401.000-3309.000=92.000
mean8.610-8.677=-0.067
σ0.155-0.282=-0.127
min8.458-8.437=0.021
max8.855-9.147=-0.293

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.989-1.728=-0.739
σ0.133-0.098=0.035
min0.892-1.614=-0.722
max1.198-1.854=-0.656

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.355-468.326=0.028
σ574.227-574.230=-0.003
min181.228-181.210=0.018
max1329.695-1329.671=0.023
mean88.250
σ8.500
min84.000
max101.000
mean2844.000-2430.000=414.000
σ0.000
min2844.000-2430.000=414.000
max2844.000-2430.000=414.000
mean0.442-0.552=-0.111
σ0.299-0.540=-0.241
min0.289-0.281=0.008
max0.890-1.363=-0.473
policies=20
mean1812.640-1812.436=0.204
σ0.396-0.387=0.009
min1812.363-1812.182=0.182
max1813.223-1813.010=0.213
mean840.000
σ0.000
min840.000
max840.000
mean2844.000-2430.000=414.000
σ0.000
min2844.000-2430.000=414.000
max2844.000-2430.000=414.000
mean2.883-2.809=0.074
σ0.003-0.012=-0.009
min2.879-2.798=0.081
max2.887-2.826=0.061
policies=200
mean18132.289-18131.561=0.728
σ0.642-0.551=0.091
min18131.496-18131.121=0.375
max18133.041-18132.363=0.678
mean8400.000
σ0.000
min8400.000
max8400.000
mean2844.000-2430.000=414.000
σ0.000
min2844.000-2430.000=414.000
max2844.000-2430.000=414.000
mean28.721-28.439=0.282
σ0.308-0.093=0.215
min28.333-28.345=-0.011
max29.064-28.531=0.532