Compare commits

Home / Compare 2bebca95 .. da87e9b8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.374=0.005
σ0.045-0.057=-0.012
min70.350-70.337=0.013
max70.506-70.533=-0.027
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.158-0.160=-0.002
σ0.004-0.002=0.002
min0.152-0.158=-0.005
max0.162-0.163=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.002
σ0.002-0.002=-0.000
min21.143-21.139=0.004
max21.149-21.145=0.003
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.064-0.065=-0.001
σ0.002-0.003=-0.001
min0.062-0.062=-0.000
max0.068-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.201=0.186
σ0.363-0.360=0.003
min1751.819-1751.632=0.187
max1752.971-1752.771=0.200
mean1656.800-1653.000=3.800
σ635.125-643.477=-8.352
min689.000-631.000=58.000
max2773.000-2851.000=-78.000
mean2.788-2.841=-0.053
σ0.190-0.126=0.063
min2.255-2.546=-0.290
max3.152-3.011=0.140

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.126-269.932=0.194
σ0.009-0.008=0.002
min270.112-269.922=0.190
max270.134-269.944=0.190
mean2773.000-2851.000=-78.000
σ0.000
min2773.000-2851.000=-78.000
max2773.000-2851.000=-78.000
mean0.380-0.376=0.005
σ0.013-0.007=0.006
min0.370-0.370=0.000
max0.395-0.383=0.012
iters=5
new-facts=1
prior-facts=6402
mean1930.595-1930.400=0.195
σ0.014-0.006=0.007
min1930.580-1930.393=0.187
max1930.611-1930.408=0.203
mean2773.000-2851.000=-78.000
σ0.000
min2773.000-2851.000=-78.000
max2773.000-2851.000=-78.000
mean2.585-2.617=-0.032
σ0.161-0.254=-0.094
min2.458-2.461=-0.004
max2.843-3.062=-0.220
iters=5
new-facts=6402
prior-facts=1
mean4750.929-4750.844=0.085
σ1.004-0.857=0.148
min4750.041-4750.351=-0.311
max4752.660-4752.370=0.290
mean2773.000-2851.000=-78.000
σ0.000
min2773.000-2851.000=-78.000
max2773.000-2851.000=-78.000
mean8.770-8.643=0.127
σ0.206-0.299=-0.093
min8.566-8.128=0.437
max9.054-8.868=0.187
iters=5
new-facts=6402
prior-facts=6402
mean4941.523-4941.334=0.189
σ0.089-0.089=-0.001
min4941.445-4941.257=0.188
max4941.620-4941.437=0.183
mean3022.000-3044.600=-22.600
σ228.759-198.430=30.329
min2773.000-2851.000=-78.000
max3322.000-3321.000=1.000
mean8.517-8.569=-0.051
σ0.113-0.257=-0.144
min8.424-8.374=0.050
max8.679-8.996=-0.317

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.077-1.042=0.035
σ0.101-0.130=-0.029
min0.941-0.929=0.012
max1.226-1.246=-0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.364-465.915=0.449
σ575.920-575.756=0.164
min178.396-178.032=0.364
max1330.243-1329.549=0.694
mean84.000-81.750=2.250
σ8.000-7.500=0.500
min80.000-78.000=2.000
max96.000-93.000=3.000
mean2773.000-2851.000=-78.000
σ0.000
min2773.000-2851.000=-78.000
max2773.000-2851.000=-78.000
mean0.445-0.443=0.002
σ0.308-0.303=0.005
min0.289-0.286=0.002
max0.907-0.898=0.010
policies=20
mean1784.256-1780.525=3.731
σ0.379-0.353=0.027
min1784.016-1780.270=3.746
max1784.817-1781.038=3.779
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2773.000-2851.000=-78.000
σ0.000
min2773.000-2851.000=-78.000
max2773.000-2851.000=-78.000
mean2.849-2.901=-0.052
σ0.094-0.063=0.031
min2.765-2.841=-0.075
max2.980-2.964=0.016
policies=200
mean17848.876-17811.542=37.334
σ0.485-0.345=0.140
min17848.593-17811.329=37.264
max17849.600-17812.057=37.543
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2773.000-2851.000=-78.000
σ0.000
min2773.000-2851.000=-78.000
max2773.000-2851.000=-78.000
mean28.020-28.325=-0.305
σ0.081-0.492=-0.411
min27.953-27.748=0.205
max28.134-28.773=-0.639