Compare commits

Home / Compare 5e3bdff6 .. 97ed9356

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.390=0.340
σ0.046-0.047=-0.000
min70.704-70.360=0.344
max70.859-70.520=0.339
mean414.400-415.000=-0.600
σ0.516-0.000=0.516
min414.000-415.000=-1.000
max415.000
mean0.162-0.158=0.004
σ0.009-0.005=0.004
min0.152-0.151=0.001
max0.176-0.166=0.011
cache=y
dps=1
iters=10
policies=100
mean21.446-21.145=0.301
σ0.002-0.002=0.000
min21.443-21.143=0.300
max21.450-21.149=0.300
mean415.000
σ0.000
min415.000
max415.000
mean0.065-0.066=-0.000
σ0.003-0.002=0.000
min0.063-0.063=-0.000
max0.072-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.528-1752.394=2.133
σ0.364-0.362=0.002
min1753.956-1751.825=2.131
max1755.111-1752.996=2.114
mean1654.650-1658.600=-3.950
σ632.641-628.891=3.750
min642.000-619.000=23.000
max2845.000-2773.000=72.000
mean2.794-2.779=0.015
σ0.190-0.157=0.033
min2.275-2.373=-0.099
max3.041-2.983=0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.610-270.231=3.380
σ0.007-0.008=-0.001
min273.601-270.220=3.381
max273.618-270.241=3.377
mean2845.000-2773.000=72.000
σ0.000
min2845.000-2773.000=72.000
max2845.000-2773.000=72.000
mean0.387-0.377=0.010
σ0.010-0.006=0.005
min0.379-0.370=0.009
max0.403-0.383=0.020
iters=5
new-facts=1
prior-facts=6402
mean1934.001-1930.700=3.302
σ0.019-0.017=0.002
min1933.973-1930.673=3.300
max1934.023-1930.717=3.307
mean2845.000-2773.000=72.000
σ0.000
min2845.000-2773.000=72.000
max2845.000-2773.000=72.000
mean3.104-2.534=0.570
σ0.328-0.097=0.231
min2.870-2.417=0.453
max3.679-2.678=1.002
iters=5
new-facts=6402
prior-facts=1
mean4614.224-4751.442=-137.217
σ314.523-0.885=313.638
min4051.591-4750.861=-699.270
max4756.329-4753.001=3.329
mean2845.000-2773.000=72.000
σ0.000
min2845.000-2773.000=72.000
max2845.000-2773.000=72.000
mean8.139-8.258=-0.119
σ0.723-0.669=0.054
min7.017-7.608=-0.592
max8.790-9.146=-0.356
iters=5
new-facts=6402
prior-facts=6402
mean4945.220-4941.718=3.502
σ0.015-0.202=-0.187
min4945.202-4941.465=3.737
max4945.244-4941.884=3.360
mean3025.200-3052.000=-26.800
σ263.403-342.809=-79.406
min2845.000-2773.000=72.000
max3445.000-3563.000=-118.000
mean8.567-8.417=0.150
σ0.185-0.126=0.059
min8.413-8.338=0.075
max8.792-8.628=0.164

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.094-1.045=0.049
σ0.182-0.133=0.049
min0.924-0.926=-0.002
max1.324-1.252=0.072

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.841-466.378=6.464
σ574.938-575.929=-0.990
min185.372-178.408=6.964
max1335.249-1330.271=4.978
mean88.250-84.250=4.000
σ8.500
min84.000-80.000=4.000
max101.000-97.000=4.000
mean2845.000-2773.000=72.000
σ0.000
min2845.000-2773.000=72.000
max2845.000-2773.000=72.000
mean0.452-0.442=0.010
σ0.308-0.303=0.004
min0.296-0.285=0.011
max0.913-0.897=0.016
policies=20
mean1854.017-1784.367=69.649
σ0.373-0.359=0.015
min1853.743-1784.132=69.611
max1854.560-1784.897=69.663
mean840.000-800.000=40.000
σ0.000
min840.000-800.000=40.000
max840.000-800.000=40.000
mean2845.000-2773.000=72.000
σ0.000
min2845.000-2773.000=72.000
max2845.000-2773.000=72.000
mean2.955-2.830=0.125
σ0.027-0.120=-0.094
min2.929-2.767=0.162
max2.982-3.010=-0.028
policies=200
mean18546.653-17849.755=696.898
σ0.543-0.485=0.059
min18546.296-17849.441=696.855
max18547.459-17850.470=696.989
mean8400.000-8000.000=400.000
σ0.000
min8400.000-8000.000=400.000
max8400.000-8000.000=400.000
mean2845.000-2773.000=72.000
σ0.000
min2845.000-2773.000=72.000
max2845.000-2773.000=72.000
mean29.192-27.931=1.262
σ0.469-0.098=0.371
min28.701-27.817=0.884
max29.646-28.023=1.622