Compare commits

Home / Compare 23deab64 .. a695102e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.047-73.048=-0.001
σ0.049-0.047=0.003
min73.025-73.016=0.009
max73.187-73.177=0.009
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.161-0.166=-0.005
σ0.003-0.011=-0.008
min0.158-0.157=0.001
max0.167-0.187=-0.020
cache=y
dps=1
iters=10
policies=100
mean23.741-23.740=0.001
σ0.003-0.002=0.001
min23.738-23.736=0.002
max23.749-23.744=0.005
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.066-0.064=0.003
σ0.003-0.003=-0.000
min0.065-0.060=0.005
max0.074-0.070=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1758.788=-0.000
σ0.360-0.361=-0.001
min1758.219-1758.219=-0.000
max1759.372-1759.372=-0.001
mean1645.450-1634.200=11.250
σ627.648-596.229=31.419
min617.000-676.000=-59.000
max2769.000-2430.000=339.000
mean2.895-2.879=0.016
σ0.226-0.096=0.130
min2.206-2.688=-0.482
max3.400-3.047=0.353

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.015-324.017=-0.002
σ0.049-0.043=0.007
min323.928-323.941=-0.012
max324.048-324.043=0.005
mean2769.000-2430.000=339.000
σ0.000
min2769.000-2430.000=339.000
max2769.000-2430.000=339.000
mean0.428-0.429=-0.001
σ0.006-0.003=0.003
min0.423-0.424=-0.000
max0.437-0.431=0.006
iters=5
new-facts=1
prior-facts=6402
mean1984.599-1984.595=0.004
σ0.006-0.006=0.000
min1984.588-1984.587=0.000
max1984.603-1984.602=0.002
mean2769.000-2430.000=339.000
σ0.000
min2769.000-2430.000=339.000
max2769.000-2430.000=339.000
mean2.671-2.627=0.044
σ0.193-0.114=0.080
min2.503-2.546=-0.043
max2.890-2.826=0.064
iters=5
new-facts=6402
prior-facts=1
mean4808.076-4808.294=-0.219
σ7.859-7.782=0.077
min4804.183-4804.678=-0.495
max4822.125-4822.212=-0.087
mean2769.000-2430.000=339.000
σ0.000
min2769.000-2430.000=339.000
max2769.000-2430.000=339.000
mean8.331-8.697=-0.366
σ0.464-0.714=-0.250
min7.718-7.448=0.270
max8.874-9.201=-0.327
iters=5
new-facts=6402
prior-facts=6402
mean4995.802-4995.668=0.133
σ0.026-0.200=-0.174
min4995.763-4995.425=0.337
max4995.834-4995.822=0.012
mean3031.400-2990.400=41.000
σ214.351-300.201=-85.850
min2769.000-2581.000=188.000
max3321.000-3359.000=-38.000
mean8.654-8.593=0.062
σ0.170-0.134=0.036
min8.451-8.492=-0.041
max8.858-8.829=0.029

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.051-1.725=-0.674
σ0.173-0.037=0.136
min0.911-1.674=-0.763
max1.337-1.766=-0.428

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.351-468.325=0.026
σ574.232-574.227=0.004
min181.232-181.208=0.024
max1329.699-1329.666=0.032
mean88.250
σ8.500
min84.000
max101.000
mean2769.000-2430.000=339.000
σ0.000
min2769.000-2430.000=339.000
max2769.000-2430.000=339.000
mean0.444-0.554=-0.111
σ0.301-0.538=-0.237
min0.290-0.282=0.008
max0.894-1.361=-0.467
policies=20
mean1812.628-1812.432=0.196
σ0.411-0.396=0.015
min1812.341-1812.161=0.181
max1813.232-1813.014=0.218
mean840.000
σ0.000
min840.000
max840.000
mean2769.000-2430.000=339.000
σ0.000
min2769.000-2430.000=339.000
max2769.000-2430.000=339.000
mean2.890-2.831=0.059
σ0.021-0.046=-0.026
min2.865-2.791=0.075
max2.916-2.895=0.021
policies=200
mean18131.569-18131.685=-0.116
σ0.470-0.458=0.011
min18131.217-18131.343=-0.126
max18132.220-18132.361=-0.141
mean8400.000
σ0.000
min8400.000
max8400.000
mean2769.000-2430.000=339.000
σ0.000
min2769.000-2430.000=339.000
max2769.000-2430.000=339.000
mean28.397-28.407=-0.011
σ0.198-0.056=0.142
min28.249-28.341=-0.092
max28.688-28.466=0.222