Compare commits

Home / Compare fe4a92df .. be26ebf1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.712-70.707=0.005
σ0.048-0.045=0.003
min70.674-70.675=-0.001
max70.844-70.831=0.013
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.157-0.160=-0.003
σ0.004-0.003=0.001
min0.151-0.156=-0.005
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.414-21.413=0.002
σ0.003-0.003=0.000
min21.409-21.407=0.001
max21.418-21.416=0.002
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.066-0.065=0.000
σ0.003-0.003=0.001
min0.063-0.063=-0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.931=-0.000
σ0.361-0.360=0.002
min1754.366-1754.358=0.008
max1755.521-1755.526=-0.004
mean1672.750-1644.800=27.950
σ643.041-632.089=10.952
min671.000-621.000=50.000
max2712.000-2770.000=-58.000
mean2.794-2.824=-0.030
σ0.174-0.134=0.040
min2.414-2.503=-0.089
max3.035-3.042=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.794-272.792=0.002
σ0.005-0.009=-0.003
min272.789-272.781=0.008
max272.802-272.803=-0.001
mean2712.000-2770.000=-58.000
σ0.000
min2712.000-2770.000=-58.000
max2712.000-2770.000=-58.000
mean0.379-0.383=-0.004
σ0.002-0.010=-0.008
min0.376-0.378=-0.002
max0.380-0.401=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1933.218-1933.228=-0.010
σ0.021-0.014=0.007
min1933.193-1933.208=-0.015
max1933.240-1933.242=-0.002
mean2712.000-2770.000=-58.000
σ0.000
min2712.000-2770.000=-58.000
max2712.000-2770.000=-58.000
mean3.055-3.019=0.036
σ0.062-0.175=-0.113
min3.018-2.793=0.225
max3.165-3.283=-0.118
iters=5
new-facts=6402
prior-facts=1
mean4756.949-4756.964=-0.014
σ7.589-7.679=-0.090
min4753.436-4753.426=0.009
max4770.524-4770.699=-0.175
mean2712.000-2770.000=-58.000
σ0.000
min2712.000-2770.000=-58.000
max2712.000-2770.000=-58.000
mean8.645-8.618=0.027
σ0.366-0.569=-0.203
min8.276-7.895=0.381
max9.133-9.401=-0.268
iters=5
new-facts=6402
prior-facts=6402
mean4944.389-4944.378=0.011
σ0.157-0.171=-0.013
min4944.109-4944.074=0.036
max4944.475-4944.470=0.005
mean2976.000-3013.800=-37.800
σ310.228-302.193=8.035
min2712.000-2770.000=-58.000
max3435.000-3461.000=-26.000
mean8.448-8.435=0.013
σ0.060-0.073=-0.012
min8.382-8.337=0.045
max8.518-8.502=0.015

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.032-0.984=0.047
σ0.188-0.140=0.047
min0.902-0.917=-0.015
max1.345-1.235=0.110

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.313-468.338=-0.025
σ574.240-574.256=-0.016
min181.189-181.202=-0.013
max1329.672-1329.722=-0.050
mean88.250
σ8.500
min84.000
max101.000
mean2712.000-2770.000=-58.000
σ0.000
min2712.000-2770.000=-58.000
max2712.000-2770.000=-58.000
mean0.568-0.442=0.125
σ0.563-0.303=0.260
min0.285-0.288=-0.003
max1.412-0.897=0.515
policies=20
mean1812.192-1812.359=-0.166
σ0.388-0.388=-0.000
min1811.934-1812.084=-0.150
max1812.767-1812.926=-0.159
mean840.000
σ0.000
min840.000
max840.000
mean2712.000-2770.000=-58.000
σ0.000
min2712.000-2770.000=-58.000
max2712.000-2770.000=-58.000
mean2.822-2.893=-0.070
σ0.006-0.022=-0.016
min2.815-2.875=-0.060
max2.829-2.920=-0.091
policies=200
mean18129.305-18129.106=0.199
σ0.475-0.427=0.048
min18129.006-18128.635=0.371
max18130.014-18129.632=0.382
mean8400.000
σ0.000
min8400.000
max8400.000
mean2712.000-2770.000=-58.000
σ0.000
min2712.000-2770.000=-58.000
max2712.000-2770.000=-58.000
mean28.445-28.430=0.015
σ0.040-0.199=-0.159
min28.390-28.220=0.170
max28.479-28.698=-0.219