Compare commits

Home / Compare 2e584c96 .. d65ea812

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.729-70.684=0.045
σ0.048-0.044=0.003
min70.701-70.658=0.044
max70.863-70.808=0.055
mean413.000-410.000=3.000
σ0.000
min413.000-410.000=3.000
max413.000-410.000=3.000
mean0.159-0.160=-0.001
σ0.004-0.003=0.001
min0.152-0.157=-0.004
max0.165-0.165=0.000
cache=y
dps=1
iters=10
policies=100
mean21.447-21.420=0.026
σ0.003-0.003=0.000
min21.442-21.416=0.026
max21.451-21.424=0.026
mean413.000-410.000=3.000
σ0.000
min413.000-410.000=3.000
max413.000-410.000=3.000
mean0.066-0.063=0.003
σ0.002-0.003=-0.001
min0.064-0.059=0.005
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.458=0.069
σ0.363-0.359=0.004
min1753.954-1753.889=0.064
max1755.127-1755.033=0.095
mean1639.450-1648.200=-8.750
σ626.862-640.716=-13.853
min622.000-648.000=-26.000
max2840.000-2871.000=-31.000
mean2.730-2.825=-0.095
σ0.207-0.131=0.076
min2.244-2.556=-0.312
max2.962-3.053=-0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.609-273.505=0.103
σ0.006-0.008=-0.002
min273.602-273.497=0.105
max273.614-273.519=0.095
mean2840.000-2871.000=-31.000
σ0.000
min2840.000-2871.000=-31.000
max2840.000-2871.000=-31.000
mean0.387-0.387=-0.000
σ0.005-0.003=0.002
min0.382-0.385=-0.003
max0.395-0.392=0.003
iters=5
new-facts=1
prior-facts=6402
mean1934.002-1933.897=0.105
σ0.007-0.009=-0.002
min1933.995-1933.886=0.108
max1934.010-1933.906=0.103
mean2840.000-2871.000=-31.000
σ0.000
min2840.000-2871.000=-31.000
max2840.000-2871.000=-31.000
mean2.996-3.002=-0.005
σ0.158-0.147=0.011
min2.741-2.787=-0.046
max3.142-3.188=-0.046
iters=5
new-facts=6402
prior-facts=1
mean4754.773-4754.739=0.034
σ0.839-0.792=0.048
min4754.246-4754.335=-0.089
max4756.264-4756.154=0.110
mean2840.000-2871.000=-31.000
σ0.000
min2840.000-2871.000=-31.000
max2840.000-2871.000=-31.000
mean8.498-7.980=0.517
σ0.529-0.256=0.273
min7.625-7.839=-0.214
max9.049-8.435=0.615
iters=5
new-facts=6402
prior-facts=6402
mean4945.158-4945.112=0.046
σ0.166-0.014=0.152
min4944.864-4945.090=-0.226
max4945.263-4945.124=0.139
mean3050.000-3041.600=8.400
σ195.032-253.416=-58.384
min2840.000-2871.000=-31.000
max3330.000-3449.000=-119.000
mean8.802-8.432=0.371
σ0.301-0.069=0.232
min8.510-8.327=0.183
max9.305-8.498=0.808

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.008-1.077=-0.069
σ0.127-0.238=-0.111
min0.926-0.936=-0.011
max1.215-1.488=-0.274

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.845-472.574=0.271
σ574.926-574.939=-0.013
min185.376-185.093=0.283
max1335.234-1334.983=0.251
mean88.250
σ8.500
min84.000
max101.000
mean2840.000-2871.000=-31.000
σ0.000
min2840.000-2871.000=-31.000
max2840.000-2871.000=-31.000
mean0.488-0.450=0.037
σ0.375-0.312=0.063
min0.298-0.280=0.018
max1.050-0.918=0.132
policies=20
mean1854.032-1851.271=2.761
σ0.360-0.378=-0.018
min1853.778-1850.988=2.791
max1854.559-1851.822=2.737
mean840.000
σ0.000
min840.000
max840.000
mean2840.000-2871.000=-31.000
σ0.000
min2840.000-2871.000=-31.000
max2840.000-2871.000=-31.000
mean2.962-2.954=0.008
σ0.004-0.011=-0.007
min2.957-2.940=0.017
max2.967-2.966=0.001
policies=200
mean18546.633-18519.474=27.159
σ0.406-0.489=-0.084
min18546.277-18519.183=27.094
max18547.203-18520.207=26.996
mean8400.000
σ0.000
min8400.000
max8400.000
mean2840.000-2871.000=-31.000
σ0.000
min2840.000-2871.000=-31.000
max2840.000-2871.000=-31.000
mean29.140-29.253=-0.113
σ0.566-0.405=0.161
min28.790-28.954=-0.164
max29.986-29.820=0.166