Compare commits

Home / Compare c0f1fc8c .. 8136b7dc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.564=0.000
σ0.049-0.043=0.006
min70.536-70.543=-0.007
max70.702-70.686=0.016
mean415.000-415.800=-0.800
σ0.000-0.422=-0.422
min415.000
max415.000-416.000=-1.000
mean0.159-0.161=-0.003
σ0.005-0.003=0.002
min0.153-0.158=-0.006
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.287-21.287=-0.001
σ0.002-0.002=-0.000
min21.284-21.283=0.001
max21.291-21.290=0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.061-0.063=-0.002
σ0.003-0.003=-0.001
min0.059-0.058=0.001
max0.067-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.570-1753.571=-0.001
σ0.361-0.361=-0.001
min1752.999-1753.000=-0.001
max1754.169-1754.156=0.014
mean1652.800-1656.850=-4.050
σ639.847-644.086=-4.239
min632.000-629.000=3.000
max2857.000-2898.000=-41.000
mean2.820-2.825=-0.006
σ0.188-0.164=0.024
min2.175-2.369=-0.194
max2.999-3.049=-0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.019-272.016=0.003
σ0.009-0.006=0.003
min272.011-272.007=0.004
max272.033-272.022=0.012
mean2857.000-2898.000=-41.000
σ0.000
min2857.000-2898.000=-41.000
max2857.000-2898.000=-41.000
mean0.395-0.388=0.007
σ0.018-0.010=0.008
min0.378-0.378=-0.000
max0.421-0.402=0.019
iters=5
new-facts=1
prior-facts=6402
mean1932.432-1932.434=-0.002
σ0.005-0.008=-0.003
min1932.428-1932.423=0.005
max1932.438-1932.442=-0.004
mean2857.000-2898.000=-41.000
σ0.000
min2857.000-2898.000=-41.000
max2857.000-2898.000=-41.000
mean3.021-2.982=0.039
σ0.088-0.065=0.023
min2.936-2.908=0.028
max3.137-3.086=0.052
iters=5
new-facts=6402
prior-facts=1
mean4753.174-4753.137=0.037
σ0.852-0.854=-0.001
min4752.707-4752.692=0.016
max4754.690-4754.661=0.029
mean2857.000-2898.000=-41.000
σ0.000
min2857.000-2898.000=-41.000
max2857.000-2898.000=-41.000
mean8.487-8.928=-0.440
σ0.509-0.316=0.193
min7.669-8.462=-0.794
max8.953-9.230=-0.277
iters=5
new-facts=6402
prior-facts=6402
mean4943.562-4943.494=0.069
σ0.151-0.190=-0.039
min4943.293-4943.278=0.015
max4943.652-4943.669=-0.017
mean3059.200-3038.800=20.400
σ197.779-169.856=27.923
min2857.000-2898.000=-41.000
max3310.000-3314.000=-4.000
mean8.591-8.643=-0.051
σ0.145-0.397=-0.252
min8.432-8.326=0.105
max8.742-9.318=-0.576

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.071-1.022=0.049
σ0.241-0.146=0.095
min0.927-0.924=0.003
max1.489-1.258=0.231

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.081-473.081=0.000
σ575.916-575.915=0.001
min185.116-185.114=0.002
max1336.955-1336.953=0.002
mean88.250
σ8.500
min84.000
max101.000
mean2857.000-2898.000=-41.000
σ0.000
min2857.000-2898.000=-41.000
max2857.000-2898.000=-41.000
mean0.486-0.487=-0.001
σ0.375-0.375=0.001
min0.296-0.297=-0.002
max1.049-1.049=-0.000
policies=20
mean1851.474-1851.465=0.008
σ0.378-0.373=0.005
min1851.183-1851.182=0.001
max1852.022-1852.006=0.016
mean840.000
σ0.000
min840.000
max840.000
mean2857.000-2898.000=-41.000
σ0.000
min2857.000-2898.000=-41.000
max2857.000-2898.000=-41.000
mean2.954-2.948=0.006
σ0.018-0.010=0.008
min2.938-2.940=-0.002
max2.980-2.963=0.017
policies=200
mean18521.064-18521.097=-0.033
σ0.390-0.551=-0.161
min18520.765-18520.772=-0.007
max18521.629-18521.920=-0.291
mean8400.000
σ0.000
min8400.000
max8400.000
mean2857.000-2898.000=-41.000
σ0.000
min2857.000-2898.000=-41.000
max2857.000-2898.000=-41.000
mean29.065-29.218=-0.153
σ0.492-0.521=-0.029
min28.687-28.740=-0.053
max29.761-29.778=-0.017