Compare commits

Home / Compare cfd0a213 .. dad2c7ce

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.793-35.793=-0.000
σ0.107-0.107=0.001
min35.742-35.738=0.004
max36.097-36.094=0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.076-0.074=0.002
σ0.004-0.005=-0.001
min0.073-0.069=0.004
max0.083-0.080=0.002
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.001
σ0.004-0.004=-0.001
min26.058-26.057=0.000
max26.068-26.071=-0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.058-0.061=-0.003
σ0.003-0.003=0.000
min0.056-0.059=-0.003
max0.065-0.069=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.106-1756.106=0.001
σ0.364-0.367=-0.003
min1755.536-1755.531=0.005
max1756.696-1756.700=-0.004
mean1667.600-1668.300=-0.700
σ630.699-630.811=-0.112
min668.000-665.000=3.000
max2615.000-2624.000=-9.000
mean2.807-2.789=0.017
σ0.143-0.184=-0.042
min2.411-2.317=0.094
max2.963-3.092=-0.129

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.387-277.385=0.002
σ0.005-0.006=-0.001
min277.383-277.377=0.007
max277.396-277.393=0.003
mean2615.000-2624.000=-9.000
σ0.000
min2615.000-2624.000=-9.000
max2615.000-2624.000=-9.000
mean0.394-0.394=-0.000
σ0.001-0.005=-0.004
min0.393-0.391=0.003
max0.395-0.403=-0.008
iters=5
new-facts=1
prior-facts=6402
mean2174.634-2174.626=0.008
σ0.012-0.010=0.002
min2174.624-2174.612=0.012
max2174.650-2174.640=0.010
mean2615.000-2624.000=-9.000
σ0.000
min2615.000-2624.000=-9.000
max2615.000-2624.000=-9.000
mean2.972-2.984=-0.012
σ0.147-0.126=0.021
min2.754-2.795=-0.041
max3.158-3.148=0.010
iters=5
new-facts=6402
prior-facts=1
mean5052.673-5052.780=-0.107
σ1.083-0.969=0.114
min5051.691-5052.172=-0.481
max5054.530-5054.485=0.045
mean2615.000-2624.000=-9.000
σ0.000
min2615.000-2624.000=-9.000
max2615.000-2624.000=-9.000
mean9.209-9.004=0.205
σ0.388-0.620=-0.233
min8.820-8.107=0.713
max9.692-9.631=0.060
iters=5
new-facts=6402
prior-facts=6402
mean5188.552-5188.600=-0.047
σ0.211-0.111=0.100
min5188.201-5188.457=-0.257
max5188.720-5188.716=0.004
mean3221.600-3223.600=-2.000
σ380.772-386.268=-5.496
min2685.000-2684.000=1.000
max3695.000-3708.000=-13.000
mean8.914-8.953=-0.039
σ0.285-0.426=-0.141
min8.693-8.676=0.017
max9.382-9.699=-0.317

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.399-1.359=0.039
σ0.443-0.375=0.068
min0.947-0.944=0.003
max2.033-1.843=0.190

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.220-465.226=-0.006
σ572.652-572.663=-0.011
min178.893-178.891=0.001
max1324.198-1324.220=-0.022
mean81.750
σ7.500
min78.000
max93.000
mean2615.000-2624.000=-9.000
σ0.000
min2615.000-2624.000=-9.000
max2615.000-2624.000=-9.000
mean0.566-0.543=0.024
σ0.569-0.524=0.045
min0.280-0.279=0.001
max1.420-1.329=0.091
policies=20
mean1789.150-1789.146=0.004
σ0.372-0.358=0.014
min1788.932-1788.941=-0.009
max1789.704-1789.679=0.025
mean780.000
σ0.000
min780.000
max780.000
mean2615.000-2624.000=-9.000
σ0.000
min2615.000-2624.000=-9.000
max2615.000-2624.000=-9.000
mean2.802-2.806=-0.004
σ0.010-0.012=-0.001
min2.793-2.789=0.004
max2.816-2.813=0.003
policies=200
mean17898.271-17898.315=-0.044
σ0.515-0.502=0.012
min17897.977-17898.053=-0.076
max17899.040-17899.068=-0.028
mean7800.000
σ0.000
min7800.000
max7800.000
mean2615.000-2624.000=-9.000
σ0.000
min2615.000-2624.000=-9.000
max2615.000-2624.000=-9.000
mean28.409-28.299=0.110
σ0.153-0.105=0.048
min28.279-28.181=0.097
max28.584-28.411=0.172