Compare commits

Home / Compare 6b6f1691 .. 8c2baaa4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.048=-0.002
σ0.048-0.048=-0.001
min73.023-73.020=0.003
max73.180-73.184=-0.004
mean413.000
σ0.000
min413.000
max413.000
mean0.161-0.169=-0.009
σ0.004-0.011=-0.008
min0.158-0.158=-0.001
max0.166-0.189=-0.022
cache=y
dps=1
iters=10
policies=100
mean23.740-23.740=-0.000
σ0.003-0.003=0.000
min23.734-23.737=-0.003
max23.744-23.745=-0.000
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.064-0.065=-0.001
σ0.004-0.001=0.003
min0.060-0.064=-0.004
max0.072-0.066=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.787=-0.000
σ0.361-0.359=0.002
min1758.210-1758.223=-0.013
max1759.375-1759.354=0.020
mean1639.850-1647.150=-7.300
σ625.142-617.290=7.852
min620.000-629.000=-9.000
max2772.000-2492.000=280.000
mean2.803-2.819=-0.016
σ0.244-0.152=0.092
min2.269-2.366=-0.097
max3.115-3.058=0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean323.994-324.014=-0.019
σ0.045-0.054=-0.009
min323.918-323.917=0.001
max324.034-324.041=-0.008
mean2772.000-2492.000=280.000
σ0.000
min2772.000-2492.000=280.000
max2772.000-2492.000=280.000
mean0.431-0.427=0.004
σ0.005-0.002=0.002
min0.427-0.424=0.003
max0.437-0.429=0.008
iters=5
new-facts=1
prior-facts=6402
mean1984.589-1984.598=-0.008
σ0.022-0.015=0.007
min1984.556-1984.572=-0.016
max1984.609-1984.609=-0.000
mean2772.000-2492.000=280.000
σ0.000
min2772.000-2492.000=280.000
max2772.000-2492.000=280.000
mean2.626-2.628=-0.002
σ0.146-0.097=0.048
min2.534-2.558=-0.024
max2.885-2.794=0.090
iters=5
new-facts=6402
prior-facts=1
mean4808.224-4808.311=-0.086
σ7.813-7.747=0.066
min4804.677-4804.640=0.038
max4822.200-4822.164=0.036
mean2772.000-2492.000=280.000
σ0.000
min2772.000-2492.000=280.000
max2772.000-2492.000=280.000
mean9.023-8.709=0.314
σ0.138-0.587=-0.449
min8.881-7.785=1.096
max9.170-9.313=-0.144
iters=5
new-facts=6402
prior-facts=6402
mean4995.799-4995.807=-0.009
σ0.028-0.021=0.007
min4995.768-4995.782=-0.014
max4995.838-4995.826=0.011
mean3018.000-2930.600=87.400
σ288.464-369.481=-81.017
min2772.000-2492.000=280.000
max3441.000-3433.000=8.000
mean8.485-8.655=-0.171
σ0.055-0.183=-0.127
min8.433-8.498=-0.065
max8.576-8.938=-0.362

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.035-1.709=-0.674
σ0.186-0.163=0.023
min0.921-1.418=-0.497
max1.351-1.792=-0.440

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.355-468.328=0.027
σ574.227-574.231=-0.003
min181.232-181.207=0.025
max1329.696-1329.674=0.022
mean88.250
σ8.500
min84.000
max101.000
mean2772.000-2492.000=280.000
σ0.000
min2772.000-2492.000=280.000
max2772.000-2492.000=280.000
mean0.443-0.562=-0.120
σ0.303-0.560=-0.257
min0.288-0.280=0.008
max0.897-1.402=-0.505
policies=20
mean1812.654-1812.421=0.233
σ0.394-0.413=-0.019
min1812.365-1812.161=0.203
max1813.228-1813.035=0.193
mean840.000
σ0.000
min840.000
max840.000
mean2772.000-2492.000=280.000
σ0.000
min2772.000-2492.000=280.000
max2772.000-2492.000=280.000
mean2.942-2.836=0.106
σ0.070-0.065=0.006
min2.874-2.788=0.087
max3.009-2.930=0.079
policies=200
mean18131.741-18131.465=0.276
σ0.454-0.418=0.035
min18131.390-18131.165=0.225
max18132.405-18132.081=0.324
mean8400.000
σ0.000
min8400.000
max8400.000
mean2772.000-2492.000=280.000
σ0.000
min2772.000-2492.000=280.000
max2772.000-2492.000=280.000
mean28.463-28.228=0.236
σ0.184-0.055=0.129
min28.310-28.167=0.143
max28.702-28.278=0.424