Compare commits

Home / Compare db16dff9 .. 651f67dd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.696-70.696=-0.000
σ0.049-0.047=0.003
min70.671-70.674=-0.004
max70.835-70.828=0.007
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.160-0.160=-0.000
σ0.003-0.004=-0.000
min0.157-0.157=-0.000
max0.166-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.422-21.421=0.001
σ0.011-0.003=0.009
min21.415-21.416=-0.002
max21.453-21.424=0.029
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.065-0.065=-0.000
σ0.002-0.002=0.000
min0.063-0.063=-0.000
max0.071-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.457=0.001
σ0.361-0.359=0.002
min1753.887-1753.881=0.007
max1755.044-1755.045=-0.002
mean1656.950-1658.800=-1.850
σ641.892-628.736=13.156
min624.000-679.000=-55.000
max2883.000-2603.000=280.000
mean2.824-2.740=0.084
σ0.145-0.212=-0.068
min2.394-2.173=0.221
max3.123-3.056=0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.503-273.496=0.007
σ0.008-0.009=-0.001
min273.492-273.482=0.010
max273.515-273.508=0.007
mean2883.000-2603.000=280.000
σ0.000
min2883.000-2603.000=280.000
max2883.000-2603.000=280.000
mean0.386-0.376=0.010
σ0.005-0.007=-0.002
min0.380-0.372=0.009
max0.393-0.388=0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.889-1933.894=-0.006
σ0.009-0.009=0.000
min1933.876-1933.887=-0.011
max1933.898-1933.909=-0.011
mean2883.000-2603.000=280.000
σ0.000
min2883.000-2603.000=280.000
max2883.000-2603.000=280.000
mean3.013-2.954=0.059
σ0.087-0.175=-0.088
min2.915-2.700=0.214
max3.143-3.148=-0.005
iters=5
new-facts=6402
prior-facts=1
mean4754.580-4754.670=-0.090
σ0.603-0.820=-0.217
min4754.233-4754.145=0.087
max4755.651-4756.127=-0.476
mean2883.000-2603.000=280.000
σ0.000
min2883.000-2603.000=280.000
max2883.000-2603.000=280.000
mean8.401-8.538=-0.137
σ0.436-0.569=-0.133
min7.680-7.641=0.039
max8.739-9.095=-0.356
iters=5
new-facts=6402
prior-facts=6402
mean4945.044-4944.977=0.067
σ0.159-0.196=-0.037
min4944.761-4944.743=0.017
max4945.133-4945.143=-0.010
mean3066.800-3010.400=56.400
σ177.483-262.956=-85.473
min2883.000-2624.000=259.000
max3323.000
mean8.540-8.590=-0.050
σ0.222-0.121=0.100
min8.363-8.442=-0.079
max8.907-8.723=0.184

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.987-1.267=-0.280
σ0.143-0.341=-0.198
min0.917-0.929=-0.012
max1.243-1.732=-0.489

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.063-473.062=0.000
σ575.909-575.931=-0.021
min185.100-185.094=0.006
max1336.927-1336.958=-0.032
mean88.250
σ8.500
min84.000
max101.000
mean2883.000-2603.000=280.000
σ0.000
min2883.000-2603.000=280.000
max2883.000-2603.000=280.000
mean0.488-0.571=-0.082
σ0.380-0.569=-0.189
min0.296-0.285=0.011
max1.058-1.425=-0.367
policies=20
mean1851.298-1851.226=0.072
σ0.363-0.376=-0.013
min1851.028-1850.981=0.048
max1851.825-1851.781=0.044
mean840.000
σ0.000
min840.000
max840.000
mean2883.000-2603.000=280.000
σ0.000
min2883.000-2603.000=280.000
max2883.000-2603.000=280.000
mean2.944-2.856=0.088
σ0.008-0.012=-0.003
min2.932-2.844=0.087
max2.950-2.871=0.078
policies=200
mean18519.408-18518.623=0.785
σ0.569-0.694=-0.125
min18519.041-18518.159=0.882
max18520.256-18519.655=0.601
mean8400.000
σ0.000
min8400.000
max8400.000
mean2883.000-2603.000=280.000
σ0.000
min2883.000-2603.000=280.000
max2883.000-2603.000=280.000
mean29.228-28.802=0.427
σ0.412-0.146=0.265
min28.816-28.594=0.222
max29.744-28.936=0.808