Compare commits

Home / Compare 00905309 .. 2bb88d8d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.794-35.795=-0.000
σ0.110-0.109=0.001
min35.738-35.735=0.003
max36.106-36.103=0.003
mean413.100-415.000=-1.900
σ0.316-0.000=0.316
min413.000-415.000=-2.000
max414.000-415.000=-1.000
mean0.075-0.076=-0.000
σ0.003-0.003=-0.001
min0.073-0.073=0.000
max0.081-0.082=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.001
σ0.003-0.003=-0.000
min26.059-26.060=-0.001
max26.068-26.071=-0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.059-0.061=-0.002
σ0.004-0.003=0.001
min0.056-0.060=-0.004
max0.065-0.069=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.997-1756.998=-0.000
σ0.367-0.367=0.000
min1756.425-1756.424=0.000
max1757.584-1757.591=-0.007
mean1658.150-1655.500=2.650
σ625.816-632.456=-6.640
min672.000-663.000=9.000
max2741.000-2799.000=-58.000
mean2.825-2.797=0.028
σ0.177-0.190=-0.013
min2.304-2.179=0.126
max3.033-2.961=0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.286-278.284=0.002
σ0.005-0.006=-0.001
min278.278-278.276=0.003
max278.290-278.290=-0.000
mean2741.000-2799.000=-58.000
σ0.000
min2741.000-2799.000=-58.000
max2741.000-2799.000=-58.000
mean0.411-0.409=0.002
σ0.007-0.008=-0.001
min0.405-0.400=0.004
max0.422-0.418=0.005
iters=5
new-facts=1
prior-facts=6402
mean2175.531-2175.534=-0.003
σ0.024-0.035=-0.011
min2175.501-2175.485=0.017
max2175.568-2175.574=-0.006
mean2741.000-2799.000=-58.000
σ0.000
min2741.000-2799.000=-58.000
max2741.000-2799.000=-58.000
mean2.966-2.870=0.096
σ0.123-0.108=0.015
min2.816-2.764=0.052
max3.099-3.027=0.072
iters=5
new-facts=6402
prior-facts=1
mean5134.571-5134.562=0.010
σ0.938-0.992=-0.054
min5134.069-5134.049=0.020
max5136.240-5136.331=-0.091
mean2741.000-2799.000=-58.000
σ0.000
min2741.000-2799.000=-58.000
max2741.000-2799.000=-58.000
mean8.937-9.101=-0.165
σ0.353-0.205=0.148
min8.377-8.901=-0.524
max9.296-9.441=-0.145
iters=5
new-facts=6402
prior-facts=6402
mean5238.364-5238.366=-0.002
σ0.110-0.083=0.027
min5238.234-5238.293=-0.058
max5238.483-5238.463=0.020
mean3265.600-3273.200=-7.600
σ398.472-429.332=-30.860
min2741.000-2799.000=-58.000
max3647.000-3833.000=-186.000
mean9.286-9.096=0.190
σ0.436-0.476=-0.040
min8.824-8.772=0.052
max9.916-9.929=-0.014

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.096-1.037=0.059
σ0.114-0.135=-0.020
min0.955-0.948=0.007
max1.274-1.255=0.019

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.463-467.473=-0.010
σ572.657-572.654=0.003
min181.131-181.138=-0.007
max1326.449-1326.454=-0.005
mean85.500
σ7.000
min82.000
max96.000
mean2741.000-2799.000=-58.000
σ0.000
min2741.000-2799.000=-58.000
max2741.000-2799.000=-58.000
mean0.583-0.452=0.132
σ0.580-0.304=0.277
min0.285-0.295=-0.010
max1.454-0.907=0.546
policies=20
mean1811.630-1811.711=-0.081
σ0.382-0.353=0.029
min1811.386-1811.440=-0.055
max1812.196-1812.216=-0.020
mean820.000
σ0.000
min820.000
max820.000
mean2741.000-2799.000=-58.000
σ0.000
min2741.000-2799.000=-58.000
max2741.000-2799.000=-58.000
mean2.858-2.945=-0.087
σ0.012-0.107=-0.095
min2.843-2.859=-0.015
max2.870-3.095=-0.224
policies=200
mean18123.417-18123.431=-0.014
σ0.549-0.534=0.016
min18123.006-18123.133=-0.127
max18124.226-18124.230=-0.005
mean8200.000
σ0.000
min8200.000
max8200.000
mean2741.000-2799.000=-58.000
σ0.000
min2741.000-2799.000=-58.000
max2741.000-2799.000=-58.000
mean28.904-28.851=0.053
σ0.123-0.103=0.019
min28.723-28.716=0.007
max28.985-28.943=0.042