Compare commits

Home / Compare a7a126ab .. 6489b8ce

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.709-53.705=0.004
σ0.365-0.363=0.002
min53.569-53.574=-0.006
max54.748-54.738=0.010
mean416.000
σ0.000
min416.000
max416.000
mean0.140-0.137=0.002
σ0.003-0.004=-0.001
min0.136-0.130=0.006
max0.146-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean42.977-42.979=-0.002
σ0.006-0.006=-0.000
min42.967-42.972=-0.005
max42.985-42.989=-0.004
mean416.800-416.000=0.800
σ0.422-0.000=0.422
min416.000
max417.000-416.000=1.000
mean0.120-0.120=-0.000
σ0.004-0.004=0.000
min0.115-0.115=0.000
max0.129-0.127=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.219-994.902=0.317
σ1.187-1.177=0.010
min994.686-994.370=0.316
max1000.199-999.843=0.357
mean1061.050-1062.200=-1.150
σ311.310-315.031=-3.721
min614.000-596.000=18.000
max1629.000-1570.000=59.000
mean1.482-1.458=0.025
σ0.088-0.128=-0.040
min1.391-1.357=0.034
max1.665-1.966=-0.300

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.313-297.311=0.002
σ0.014-0.003=0.011
min297.292-297.308=-0.016
max297.326-297.315=0.011
mean1629.000-1570.000=59.000
σ0.000
min1629.000-1570.000=59.000
max1629.000-1570.000=59.000
mean0.393-0.380=0.014
σ0.009-0.002=0.007
min0.386-0.377=0.009
max0.407-0.382=0.024
iters=5
new-facts=1
prior-facts=6402
mean1299.014-1298.662=0.353
σ0.097-0.092=0.005
min1298.841-1298.503=0.338
max1299.063-1298.734=0.328
mean1629.000-1570.000=59.000
σ0.000
min1629.000-1570.000=59.000
max1629.000-1570.000=59.000
mean2.017-1.877=0.140
σ0.141-0.043=0.098
min1.890-1.844=0.045
max2.178-1.950=0.228
iters=5
new-facts=6402
prior-facts=1
mean1719.181-1718.874=0.307
σ6.896-6.945=-0.049
min1716.001-1715.661=0.340
max1731.513-1731.295=0.218
mean1629.000-1570.000=59.000
σ0.000
min1629.000-1570.000=59.000
max1629.000-1570.000=59.000
mean3.027-2.983=0.044
σ0.226-0.521=-0.295
min2.789-2.584=0.204
max3.329-3.881=-0.552
iters=5
new-facts=6402
prior-facts=6402
mean1981.935-1981.625=0.310
σ0.051-0.016=0.035
min1981.861-1981.603=0.257
max1982.001-1981.637=0.364
mean1807.600-1816.600=-9.000
σ190.227-188.744=1.483
min1629.000-1570.000=59.000
max2082.000-2051.000=31.000
mean3.351-3.263=0.088
σ0.392-0.146=0.246
min3.090-3.031=0.059
max4.042-3.413=0.630

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.208-1.461=-0.253
σ0.299-0.367=-0.069
min0.915-1.034=-0.120
max1.697-1.846=-0.150

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.456-440.360=0.095
σ573.040-572.864=0.176
min153.933-153.926=0.007
max1300.016-1299.657=0.359
mean94.250
σ8.500
min90.000
max107.000
mean1629.000-1570.000=59.000
σ0.000
min1629.000-1570.000=59.000
max1629.000-1570.000=59.000
mean0.520-0.513=0.008
σ0.524-0.494=0.030
min0.256-0.264=-0.008
max1.307-1.254=0.053
policies=20
mean1539.583-1539.503=0.079
σ0.313-0.297=0.016
min1539.384-1539.317=0.067
max1540.049-1539.944=0.105
mean900.000
σ0.000
min900.000
max900.000
mean1629.000-1570.000=59.000
σ0.000
min1629.000-1570.000=59.000
max1629.000-1570.000=59.000
mean2.581-2.558=0.023
σ0.025-0.016=0.009
min2.553-2.543=0.011
max2.605-2.575=0.030
policies=200
mean15403.773-15403.041=0.731
σ0.041-0.129=-0.088
min15403.732-15402.912=0.820
max15403.826-15403.212=0.614
mean9000.000
σ0.000
min9000.000
max9000.000
mean1629.000-1570.000=59.000
σ0.000
min1629.000-1570.000=59.000
max1629.000-1570.000=59.000
mean25.913-25.879=0.034
σ0.106-0.099=0.007
min25.783-25.776=0.006
max26.016-25.998=0.017