Compare commits

Home / Compare 9a104c25 .. a7992535

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.032-70.707=2.325
σ0.046-0.046=-0.000
min73.005-70.675=2.331
max73.160-70.833=2.327
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.157-0.162=-0.005
σ0.006-0.003=0.003
min0.148-0.158=-0.010
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.731-21.411=2.320
σ0.003-0.003=0.001
min23.725-21.408=2.317
max23.737-21.416=2.321
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.063-0.062=0.001
σ0.002-0.004=-0.002
min0.061-0.059=0.001
max0.066-0.070=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.786-1754.930=3.856
σ0.360-0.363=-0.003
min1758.208-1754.354=3.854
max1759.367-1755.525=3.842
mean1660.650-1654.550=6.100
σ627.456-623.578=3.878
min623.000-688.000=-65.000
max2520.000-2717.000=-197.000
mean2.850-2.775=0.076
σ0.109-0.205=-0.096
min2.555-2.312=0.244
max3.059-2.999=0.060

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.011-272.791=51.220
σ0.047-0.004=0.043
min323.927-272.788=51.139
max324.040-272.797=51.243
mean2520.000-2717.000=-197.000
σ0.000
min2520.000-2717.000=-197.000
max2520.000-2717.000=-197.000
mean0.425-0.378=0.047
σ0.004-0.006=-0.002
min0.423-0.374=0.049
max0.432-0.388=0.044
iters=5
new-facts=1
prior-facts=6402
mean1984.589-1933.232=51.357
σ0.019-0.015=0.004
min1984.557-1933.218=51.339
max1984.605-1933.256=51.349
mean2520.000-2717.000=-197.000
σ0.000
min2520.000-2717.000=-197.000
max2520.000-2717.000=-197.000
mean2.676-2.979=-0.303
σ0.170-0.129=0.042
min2.541-2.753=-0.212
max2.895-3.074=-0.179
iters=5
new-facts=6402
prior-facts=1
mean4808.228-4756.864=51.364
σ7.742-7.717=0.026
min4804.653-4752.829=51.824
max4822.077-4770.654=51.423
mean2520.000-2717.000=-197.000
σ0.000
min2520.000-2717.000=-197.000
max2520.000-2717.000=-197.000
mean8.904-8.573=0.332
σ0.201-0.621=-0.420
min8.620-7.640=0.980
max9.164-9.151=0.013
iters=5
new-facts=6402
prior-facts=6402
mean4995.795-4944.454=51.341
σ0.019-0.023=-0.004
min4995.771-4944.431=51.340
max4995.819-4944.485=51.333
mean2948.000-3014.400=-66.400
σ267.398-245.161=22.237
min2588.000-2717.000=-129.000
max3288.000-3324.000=-36.000
mean8.545-8.598=-0.052
σ0.057-0.158=-0.102
min8.459-8.418=0.041
max8.614-8.753=-0.139

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.582-1.014=0.569
σ0.202-0.140=0.062
min1.235-0.918=0.318
max1.765-1.239=0.526

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.323-468.318=0.005
σ574.231-574.243=-0.011
min181.202-181.188=0.015
max1329.670-1329.682=-0.012
mean88.250
σ8.500
min84.000
max101.000
mean2520.000-2717.000=-197.000
σ0.000
min2520.000-2717.000=-197.000
max2520.000-2717.000=-197.000
mean0.563-0.560=0.004
σ0.565-0.537=0.028
min0.268-0.290=-0.022
max1.411-1.365=0.045
policies=20
mean1812.389-1812.195=0.194
σ0.386-0.378=0.007
min1812.128-1811.943=0.185
max1812.962-1812.756=0.206
mean840.000
σ0.000
min840.000
max840.000
mean2520.000-2717.000=-197.000
σ0.000
min2520.000-2717.000=-197.000
max2520.000-2717.000=-197.000
mean2.805-2.816=-0.011
σ0.012-0.019=-0.007
min2.790-2.792=-0.003
max2.817-2.831=-0.014
policies=200
mean18131.240-18129.003=2.237
σ0.559-0.602=-0.043
min18130.863-18128.645=2.218
max18132.066-18129.902=2.164
mean8400.000
σ0.000
min8400.000
max8400.000
mean2520.000-2717.000=-197.000
σ0.000
min2520.000-2717.000=-197.000
max2520.000-2717.000=-197.000
mean28.396-28.423=-0.027
σ0.159-0.067=0.092
min28.204-28.354=-0.151
max28.560-28.515=0.044