Compare commits

Home / Compare a0ed86ec .. 23deab64

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.048-73.043=0.005
σ0.047-0.046=0.001
min73.016-73.020=-0.004
max73.177-73.173=0.004
mean413.000
σ0.000
min413.000
max413.000
mean0.166-0.158=0.008
σ0.011-0.004=0.007
min0.157-0.152=0.005
max0.187-0.164=0.024
cache=y
dps=1
iters=10
policies=100
mean23.740-23.741=-0.001
σ0.002-0.003=-0.001
min23.736-23.735=0.002
max23.744-23.747=-0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.064-0.064=0.000
σ0.003-0.004=-0.000
min0.060-0.059=0.000
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1758.787=0.001
σ0.361-0.361=-0.000
min1758.219-1758.221=-0.003
max1759.372-1759.374=-0.002
mean1634.200-1660.100=-25.900
σ596.229-630.166=-33.938
min676.000-629.000=47.000
max2430.000-2524.000=-94.000
mean2.879-2.799=0.080
σ0.096-0.170=-0.074
min2.688-2.167=0.521
max3.047-2.981=0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.017-324.010=0.007
σ0.043-0.060=-0.017
min323.941-323.903=0.037
max324.043-324.040=0.003
mean2430.000-2524.000=-94.000
σ0.000
min2430.000-2524.000=-94.000
max2430.000-2524.000=-94.000
mean0.429-0.426=0.003
σ0.003-0.002=0.001
min0.424-0.424=-0.000
max0.431-0.429=0.002
iters=5
new-facts=1
prior-facts=6402
mean1984.595-1984.574=0.021
σ0.006-0.014=-0.008
min1984.587-1984.551=0.036
max1984.602-1984.586=0.015
mean2430.000-2524.000=-94.000
σ0.000
min2430.000-2524.000=-94.000
max2430.000-2524.000=-94.000
mean2.627-2.718=-0.091
σ0.114-0.205=-0.091
min2.546-2.583=-0.036
max2.826-3.076=-0.250
iters=5
new-facts=6402
prior-facts=1
mean4808.294-4808.063=0.232
σ7.782-7.527=0.255
min4804.678-4804.168=0.509
max4822.212-4821.514=0.698
mean2430.000-2524.000=-94.000
σ0.000
min2430.000-2524.000=-94.000
max2430.000-2524.000=-94.000
mean8.697-8.592=0.105
σ0.714-0.543=0.171
min7.448-7.753=-0.304
max9.201-9.215=-0.015
iters=5
new-facts=6402
prior-facts=6402
mean4995.668-4995.800=-0.132
σ0.200-0.034=0.166
min4995.425-4995.766=-0.341
max4995.822-4995.836=-0.014
mean2990.400-2951.800=38.600
σ300.201-388.825=-88.624
min2581.000-2524.000=57.000
max3359.000-3457.000=-98.000
mean8.593-8.631=-0.038
σ0.134-0.209=-0.074
min8.492-8.408=0.084
max8.829-8.928=-0.099

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.725-1.635=0.090
σ0.037-0.266=-0.229
min1.674-1.229=0.445
max1.766-1.842=-0.076

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.325-468.325=0.000
σ574.227-574.232=-0.004
min181.208-181.204=0.004
max1329.666-1329.672=-0.006
mean88.250
σ8.500
min84.000
max101.000
mean2430.000-2524.000=-94.000
σ0.000
min2430.000-2524.000=-94.000
max2430.000-2524.000=-94.000
mean0.554-0.574=-0.020
σ0.538-0.585=-0.047
min0.282-0.279=0.003
max1.361-1.452=-0.090
policies=20
mean1812.432-1812.398=0.034
σ0.396-0.398=-0.002
min1812.161-1812.149=0.012
max1813.014-1812.989=0.024
mean840.000
σ0.000
min840.000
max840.000
mean2430.000-2524.000=-94.000
σ0.000
min2430.000-2524.000=-94.000
max2430.000-2524.000=-94.000
mean2.831-2.815=0.016
σ0.046-0.011=0.035
min2.791-2.800=-0.009
max2.895-2.826=0.069
policies=200
mean18131.685-18131.457=0.228
σ0.458-0.402=0.056
min18131.343-18131.153=0.189
max18132.361-18132.048=0.313
mean8400.000
σ0.000
min8400.000
max8400.000
mean2430.000-2524.000=-94.000
σ0.000
min2430.000-2524.000=-94.000
max2430.000-2524.000=-94.000
mean28.407-28.273=0.134
σ0.056-0.054=0.002
min28.341-28.198=0.143
max28.466-28.315=0.151