Compare commits

Home / Compare c3f02c3c .. d7fdacdb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.742-70.698=0.045
σ0.047-0.045=0.002
min70.708-70.669=0.039
max70.872-70.823=0.049
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.156-0.159=-0.003
σ0.005-0.003=0.002
min0.151-0.152=-0.001
max0.162-0.164=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.465-21.421=0.044
σ0.003-0.002=0.000
min21.461-21.416=0.044
max21.468-21.425=0.044
mean413.000-412.800=0.200
σ0.000-0.422=-0.422
min413.000-412.000=1.000
max413.000
mean0.063-0.065=-0.002
σ0.004-0.002=0.002
min0.059-0.063=-0.004
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.457=0.001
σ0.360-0.361=-0.001
min1753.884-1753.891=-0.007
max1755.043-1755.029=0.014
mean1647.900-1643.300=4.600
σ620.260-628.940=-8.680
min621.000-623.000=-2.000
max2650.000-2858.000=-208.000
mean2.834-2.777=0.057
σ0.152-0.210=-0.058
min2.411-2.145=0.266
max3.098-3.229=-0.131

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.503-273.479=0.024
σ0.007-0.007=0.000
min273.494-273.471=0.022
max273.510-273.490=0.021
mean2650.000-2858.000=-208.000
σ0.000
min2650.000-2858.000=-208.000
max2650.000-2858.000=-208.000
mean0.384-0.375=0.008
σ0.004-0.002=0.002
min0.381-0.374=0.008
max0.391-0.378=0.012
iters=5
new-facts=1
prior-facts=6402
mean1933.900-1933.898=0.002
σ0.007-0.011=-0.004
min1933.895-1933.885=0.010
max1933.910-1933.914=-0.004
mean2650.000-2858.000=-208.000
σ0.000
min2650.000-2858.000=-208.000
max2650.000-2858.000=-208.000
mean2.930-3.107=-0.177
σ0.133-0.187=-0.053
min2.694-2.972=-0.278
max3.012-3.432=-0.420
iters=5
new-facts=6402
prior-facts=1
mean4754.391-4754.237=0.153
σ0.752-1.165=-0.413
min4753.629-4753.147=0.482
max4755.654-4756.183=-0.528
mean2650.000-2858.000=-208.000
σ0.000
min2650.000-2858.000=-208.000
max2650.000-2858.000=-208.000
mean8.786-8.437=0.348
σ0.192-0.439=-0.246
min8.454-7.668=0.787
max8.935-8.726=0.209
iters=5
new-facts=6402
prior-facts=6402
mean4945.118-4944.975=0.143
σ0.012-0.332=-0.320
min4945.103-4944.381=0.721
max4945.133-4945.143=-0.010
mean2990.000-3054.400=-64.400
σ254.731-253.595=1.136
min2650.000-2858.000=-208.000
max3292.000-3434.000=-142.000
mean8.512-8.407=0.105
σ0.139-0.114=0.025
min8.397-8.310=0.087
max8.744-8.599=0.144

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.180-1.188=-0.008
σ0.333-0.302=0.031
min0.925-0.928=-0.003
max1.729-1.531=0.198

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.064-473.078=-0.014
σ575.930-575.922=0.008
min185.094-185.111=-0.017
max1336.959-1336.961=-0.002
mean88.250
σ8.500
min84.000
max101.000
mean2650.000-2858.000=-208.000
σ0.000
min2650.000-2858.000=-208.000
max2650.000-2858.000=-208.000
mean0.592-0.489=0.103
σ0.600-0.377=0.223
min0.288-0.299=-0.012
max1.491-1.054=0.438
policies=20
mean1851.260-1851.442=-0.182
σ0.377-0.384=-0.007
min1851.004-1851.151=-0.148
max1851.817-1851.998=-0.181
mean840.000
σ0.000
min840.000
max840.000
mean2650.000-2858.000=-208.000
σ0.000
min2650.000-2858.000=-208.000
max2650.000-2858.000=-208.000
mean2.871-2.955=-0.084
σ0.003-0.010=-0.008
min2.868-2.945=-0.077
max2.873-2.966=-0.092
policies=200
mean18519.486-18519.903=-0.416
σ0.488-0.733=-0.245
min18519.193-18519.297=-0.105
max18520.217-18520.862=-0.645
mean8400.000
σ0.000
min8400.000
max8400.000
mean2650.000-2858.000=-208.000
σ0.000
min2650.000-2858.000=-208.000
max2650.000-2858.000=-208.000
mean28.990-29.142=-0.151
σ0.156-0.391=-0.236
min28.873-28.889=-0.016
max29.219-29.714=-0.495