Compare commits

Home / Compare c3cac666 .. 46d061c2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-31.039=39.341
σ0.047-0.048=-0.000
min70.355-30.999=39.355
max70.512-31.171=39.340
mean414.000
σ0.000
min414.000
max414.000
mean0.159-0.078=0.081
σ0.003-0.003=0.000
min0.157-0.075=0.082
max0.164-0.084=0.080
cache=y
dps=1
iters=10
policies=100
mean21.145-21.143=0.001
σ0.002-0.002=0.000
min21.142-21.140=0.002
max21.148-21.147=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.063-0.064=-0.000
σ0.003-0.003=-0.000
min0.059-0.058=0.001
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1751.410=0.977
σ0.361-0.362=-0.001
min1751.815-1750.840=0.976
max1752.966-1751.993=0.973
mean1661.050-1655.450=5.600
σ622.128-645.133=-23.006
min637.000-632.000=5.000
max2507.000-2849.000=-342.000
mean2.759-2.815=-0.056
σ0.239-0.116=0.123
min2.164-2.528=-0.364
max3.082-2.993=0.089

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.126-266.786=3.340
σ0.005-0.007=-0.002
min270.118-266.776=3.342
max270.133-266.795=3.338
mean2507.000-2849.000=-342.000
σ0.000
min2507.000-2849.000=-342.000
max2507.000-2849.000=-342.000
mean0.373-0.364=0.009
σ0.004-0.001=0.003
min0.369-0.362=0.007
max0.379-0.366=0.013
iters=5
new-facts=1
prior-facts=6402
mean1930.596-1927.207=3.389
σ0.016-0.011=0.005
min1930.572-1927.190=3.382
max1930.612-1927.216=3.395
mean2507.000-2849.000=-342.000
σ0.000
min2507.000-2849.000=-342.000
max2507.000-2849.000=-342.000
mean2.581-3.031=-0.451
σ0.155-0.097=0.058
min2.444-2.950=-0.506
max2.810-3.168=-0.358
iters=5
new-facts=6402
prior-facts=1
mean4750.887-4747.728=3.159
σ0.315-0.782=-0.468
min4750.684-4747.328=3.355
max4751.445-4749.126=2.319
mean2507.000-2849.000=-342.000
σ0.000
min2507.000-2849.000=-342.000
max2507.000-2849.000=-342.000
mean8.346-8.244=0.102
σ0.525-0.646=-0.121
min7.786-7.666=0.120
max8.955-9.067=-0.111
iters=5
new-facts=6402
prior-facts=6402
mean4941.453-4938.092=3.361
σ0.215-0.208=0.007
min4941.097-4937.754=3.343
max4941.636-4938.265=3.372
mean2931.200-3053.200=-122.000
σ384.586-257.959=126.628
min2507.000-2849.000=-342.000
max3430.000-3436.000=-6.000
mean8.461-8.573=-0.112
σ0.354-0.241=0.113
min8.241-8.379=-0.139
max9.090-8.982=0.108

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.714-1.158=0.555
σ0.128-0.260=-0.132
min1.577-0.929=0.649
max1.862-1.493=0.369

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.356-465.123=1.232
σ575.918-575.766=0.152
min178.392-177.234=1.158
max1330.233-1328.773=1.460
mean84.000-79.750=4.250
σ8.000-7.500=0.500
min80.000-76.000=4.000
max96.000-91.000=5.000
mean2507.000-2849.000=-342.000
σ0.000
min2507.000-2849.000=-342.000
max2507.000-2849.000=-342.000
mean0.565-0.438=0.126
σ0.563-0.304=0.259
min0.278-0.281=-0.003
max1.409-0.895=0.514
policies=20
mean1784.221-1772.619=11.602
σ0.351-0.339=0.012
min1783.995-1772.367=11.628
max1784.744-1773.113=11.631
mean800.000-760.000=40.000
σ0.000
min800.000-760.000=40.000
max800.000-760.000=40.000
mean2507.000-2849.000=-342.000
σ0.000
min2507.000-2849.000=-342.000
max2507.000-2849.000=-342.000
mean2.773-2.833=-0.061
σ0.024-0.008=0.016
min2.746-2.826=-0.081
max2.794-2.844=-0.050
policies=200
mean17848.920-17732.564=116.356
σ0.467-0.444=0.024
min17848.617-17732.294=116.323
max17849.617-17733.221=116.395
mean8000.000-7600.000=400.000
σ0.000
min8000.000-7600.000=400.000
max8000.000-7600.000=400.000
mean2507.000-2849.000=-342.000
σ0.000
min2507.000-2849.000=-342.000
max2507.000-2849.000=-342.000
mean27.854-28.184=-0.331
σ0.131-0.426=-0.295
min27.746-27.713=0.033
max28.045-28.621=-0.577