Compare commits

Home / Compare 25146c50 .. c2a786b4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-70.708=-36.729
σ0.051-0.047=0.003
min33.942-70.676=-36.734
max34.118-70.840=-36.721
mean418.900-415.000=3.900
σ0.316-0.000=0.316
min418.000-415.000=3.000
max419.000-415.000=4.000
mean0.085-0.160=-0.075
σ0.003-0.003=-0.000
min0.082-0.157=-0.075
max0.091-0.167=-0.077
cache=y
dps=1
iters=10
policies=100
mean23.317-21.411=1.906
σ0.003-0.003=-0.001
min23.314-21.407=1.907
max23.323-21.416=1.907
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.065-0.063=0.003
σ0.002-0.005=-0.002
min0.063-0.059=0.005
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1754.930=2.372
σ0.365-0.362=0.003
min1756.728-1754.357=2.372
max1757.887-1755.515=2.372
mean1652.750-1660.800=-8.050
σ624.382-620.755=3.627
min641.000-624.000=17.000
max2830.000-2511.000=319.000
mean2.395-2.759=-0.364
σ0.115-0.187=-0.072
min2.267-2.336=-0.069
max2.694-2.962=-0.268

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.453-272.794=53.659
σ0.039-0.006=0.033
min326.385-272.787=53.598
max326.481-272.803=53.678
mean2830.000-2511.000=319.000
σ0.000
min2830.000-2511.000=319.000
max2830.000-2511.000=319.000
mean0.427-0.382=0.045
σ0.004-0.007=-0.003
min0.423-0.376=0.047
max0.433-0.395=0.038
iters=5
new-facts=1
prior-facts=6402
mean1988.617-1933.226=55.391
σ0.007-0.014=-0.007
min1988.610-1933.204=55.406
max1988.626-1933.239=55.387
mean2830.000-2511.000=319.000
σ0.000
min2830.000-2511.000=319.000
max2830.000-2511.000=319.000
mean2.674-3.055=-0.381
σ0.121-0.072=0.049
min2.528-2.974=-0.445
max2.856-3.137=-0.280
iters=5
new-facts=6402
prior-facts=1
mean4813.457-4756.932=56.524
σ7.642-7.546=0.096
min4809.965-4753.459=56.507
max4827.127-4770.431=56.696
mean2830.000-2511.000=319.000
σ0.000
min2830.000-2511.000=319.000
max2830.000-2511.000=319.000
mean8.835-8.626=0.209
σ0.312-0.322=-0.010
min8.383-8.260=0.123
max9.142-8.964=0.177
iters=5
new-facts=6402
prior-facts=6402
mean5000.945-4944.376=56.569
σ0.166-0.140=0.026
min5000.649-4944.126=56.523
max5001.035-4944.454=56.581
mean3084.000-2963.800=120.200
σ253.010-387.649=-134.639
min2830.000-2511.000=319.000
max3336.000-3507.000=-171.000
mean9.714-8.406=1.307
σ0.376-0.124=0.252
min9.081-8.289=0.792
max10.023-8.605=1.418

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.741=-0.741
σ0.068-0.154=-0.085
min0.919-1.514=-0.596
max1.053-1.937=-0.885

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.439-468.306=-3.867
σ574.771-574.225=0.547
min177.044-181.189=-4.145
max1326.596-1329.643=-3.047
mean88.250
σ8.500
min84.000
max101.000
mean2830.000-2511.000=319.000
σ0.000
min2830.000-2511.000=319.000
max2830.000-2511.000=319.000
mean0.436-0.558=-0.121
σ0.306-0.546=-0.240
min0.282-0.282=0.000
max0.896-1.377=-0.481
policies=20
mean1770.797-1812.182=-41.386
σ0.362-0.383=-0.021
min1770.550-1811.932=-41.383
max1771.332-1812.750=-41.419
mean840.000
σ0.000
min840.000
max840.000
mean2830.000-2511.000=319.000
σ0.000
min2830.000-2511.000=319.000
max2830.000-2511.000=319.000
mean2.800-2.812=-0.012
σ0.008-0.011=-0.003
min2.793-2.803=-0.010
max2.811-2.828=-0.017
policies=200
mean17714.857-18128.975=-414.118
σ0.560-0.563=-0.003
min17714.324-18128.545=-414.221
max17715.646-18129.794=-414.148
mean8400.000
σ0.000
min8400.000
max8400.000
mean2830.000-2511.000=319.000
σ0.000
min2830.000-2511.000=319.000
max2830.000-2511.000=319.000
mean28.022-28.344=-0.321
σ0.468-0.065=0.403
min27.482-28.287=-0.805
max28.581-28.429=0.151