Compare commits

Home / Compare 2a031efd .. cb41b8b9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-35.798=-5.029
σ0.046-0.106=-0.060
min30.735-35.750=-5.015
max30.899-36.098=-5.200
mean414.000
σ0.000
min414.000
max414.000
mean0.077-0.075=0.002
σ0.003-0.005=-0.002
min0.073-0.070=0.004
max0.084-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-26.065=-5.005
σ0.002-0.003=-0.001
min21.057-26.061=-5.004
max21.065-26.071=-5.006
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.061=0.003
σ0.003-0.003=-0.000
min0.061-0.059=0.003
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.421-1755.923=-4.503
σ0.360-0.367=-0.007
min1750.854-1755.346=-4.492
max1752.000-1756.516=-4.516
mean1660.000-1646.600=13.400
σ621.609-626.326=-4.716
min660.000-610.000=50.000
max2503.000-2660.000=-157.000
mean2.834-2.888=-0.054
σ0.144-0.098=0.045
min2.443-2.686=-0.243
max3.088-3.050=0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.757-277.194=-1.438
σ0.008-0.005=0.003
min275.746-277.189=-1.443
max275.766-277.200=-1.435
mean2503.000-2660.000=-157.000
σ0.000
min2503.000-2660.000=-157.000
max2503.000-2660.000=-157.000
mean0.406-0.397=0.009
σ0.020-0.007=0.013
min0.387-0.391=-0.004
max0.428-0.407=0.021
iters=5
new-facts=1
prior-facts=6402
mean2168.285-2174.445=-6.159
σ0.003-0.025=-0.022
min2168.282-2174.416=-6.134
max2168.289-2174.476=-6.187
mean2503.000-2660.000=-157.000
σ0.000
min2503.000-2660.000=-157.000
max2503.000-2660.000=-157.000
mean2.967-2.860=0.107
σ0.137-0.159=-0.022
min2.791-2.760=0.031
max3.120-3.141=-0.021
iters=5
new-facts=6402
prior-facts=1
mean5047.983-5052.514=-4.531
σ1.055-1.068=-0.013
min5047.067-5051.646=-4.579
max5049.808-5054.364=-4.557
mean2503.000-2660.000=-157.000
σ0.000
min2503.000-2660.000=-157.000
max2503.000-2660.000=-157.000
mean8.854-8.755=0.100
σ0.490-0.646=-0.155
min8.085-8.154=-0.070
max9.343-9.598=-0.255
iters=5
new-facts=6402
prior-facts=6402
mean5179.240-5188.421=-9.181
σ0.069-0.085=-0.016
min5179.175-5188.354=-9.179
max5179.315-5188.517=-9.202
mean3232.000-3214.000=18.000
σ392.249-468.632=-76.383
min2706.000-2660.000=46.000
max3750.000-3834.000=-84.000
mean10.201-8.755=1.447
σ0.546-0.161=0.385
min9.591-8.670=0.921
max10.978-9.042=1.936

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.560-1.084=0.476
σ0.128-0.201=-0.073
min1.424-0.933=0.491
max1.714-1.348=0.366

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.566-464.855=-1.289
σ572.655-572.655=0.000
min177.233-178.519=-1.286
max1322.549-1323.837=-1.289
mean79.750-79.500=0.250
σ7.500-7.000=0.500
min76.000
max91.000-90.000=1.000
mean2503.000-2660.000=-157.000
σ0.000
min2503.000-2660.000=-157.000
max2503.000-2660.000=-157.000
mean0.549-0.561=-0.012
σ0.540-0.558=-0.019
min0.277-0.279=-0.002
max1.358-1.398=-0.039
policies=20
mean1772.605-1785.454=-12.849
σ0.342-0.354=-0.012
min1772.365-1785.215=-12.849
max1773.110-1785.979=-12.869
mean760.000
σ0.000
min760.000
max760.000
mean2503.000-2660.000=-157.000
σ0.000
min2503.000-2660.000=-157.000
max2503.000-2660.000=-157.000
mean2.748-2.790=-0.042
σ0.012-0.010=0.001
min2.737-2.776=-0.039
max2.764-2.799=-0.035
policies=200
mean17732.959-17861.444=-128.485
σ0.561-0.540=0.021
min17732.584-17861.064=-128.481
max17733.775-17862.234=-128.460
mean7600.000
σ0.000
min7600.000
max7600.000
mean2503.000-2660.000=-157.000
σ0.000
min2503.000-2660.000=-157.000
max2503.000-2660.000=-157.000
mean27.738-28.133=-0.395
σ0.069-0.101=-0.032
min27.684-28.038=-0.354
max27.840-28.223=-0.384