Compare commits

Home / Compare 6931280f .. a3afcf9a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.699-70.562=0.137
σ0.046-0.044=0.001
min70.676-70.540=0.135
max70.825-70.687=0.137
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.155-0.158=-0.003
σ0.006-0.006=-0.000
min0.147-0.150=-0.003
max0.164-0.168=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.420-21.291=0.129
σ0.003-0.011=-0.007
min21.414-21.284=0.129
max21.425-21.320=0.105
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.065-0.064=0.000
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.071-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.459-1753.174=1.284
σ0.360-0.360=0.000
min1753.887-1752.603=1.284
max1755.042-1753.757=1.285
mean1655.550-1652.750=2.800
σ629.225-639.477=-10.252
min622.000-628.000=-6.000
max2659.000-2792.000=-133.000
mean2.812-2.863=-0.052
σ0.163-0.117=0.046
min2.344-2.582=-0.238
max3.033-3.077=-0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.499-271.620=1.879
σ0.007-0.007=-0.000
min273.489-271.608=1.880
max273.507-271.625=1.882
mean2659.000-2792.000=-133.000
σ0.000
min2659.000-2792.000=-133.000
max2659.000-2792.000=-133.000
mean0.375-0.381=-0.005
σ0.005-0.006=-0.001
min0.370-0.377=-0.006
max0.381-0.392=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1933.901-1932.044=1.857
σ0.011-0.014=-0.003
min1933.890-1932.027=1.863
max1933.914-1932.066=1.849
mean2659.000-2792.000=-133.000
σ0.000
min2659.000-2792.000=-133.000
max2659.000-2792.000=-133.000
mean2.909-2.999=-0.090
σ0.130-0.067=0.063
min2.726-2.901=-0.175
max3.061-3.086=-0.025
iters=5
new-facts=6402
prior-facts=1
mean4754.691-4752.852=1.839
σ0.803-0.787=0.016
min4754.226-4752.451=1.775
max4756.121-4754.259=1.862
mean2659.000-2792.000=-133.000
σ0.000
min2659.000-2792.000=-133.000
max2659.000-2792.000=-133.000
mean8.262-7.875=0.387
σ0.323-0.299=0.024
min7.915-7.687=0.228
max8.631-8.396=0.234
iters=5
new-facts=6402
prior-facts=6402
mean4945.040-4943.163=1.878
σ0.158-0.168=-0.009
min4944.758-4942.864=1.894
max4945.121-4943.261=1.860
mean3011.800-3025.000=-13.200
σ388.072-279.305=108.767
min2659.000-2792.000=-133.000
max3568.000-3435.000=133.000
mean8.417-8.401=0.016
σ0.130-0.188=-0.058
min8.283-8.225=0.058
max8.630-8.684=-0.054

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.144-1.021=0.124
σ0.325-0.140=0.185
min0.932-0.929=0.003
max1.670-1.247=0.423

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.062-472.291=0.771
σ575.930-575.915=0.015
min185.093-184.324=0.769
max1336.956-1336.163=0.793
mean88.250
σ8.500
min84.000
max101.000
mean2659.000-2792.000=-133.000
σ0.000
min2659.000-2792.000=-133.000
max2659.000-2792.000=-133.000
mean0.535-0.449=0.086
σ0.496-0.303=0.193
min0.285-0.294=-0.009
max1.279-0.904=0.375
policies=20
mean1851.263-1843.558=7.705
σ0.372-0.372=-0.000
min1851.014-1843.290=7.724
max1851.813-1844.101=7.712
mean840.000
σ0.000
min840.000
max840.000
mean2659.000-2792.000=-133.000
σ0.000
min2659.000-2792.000=-133.000
max2659.000-2792.000=-133.000
mean2.861-2.939=-0.078
σ0.026-0.006=0.020
min2.834-2.934=-0.100
max2.897-2.948=-0.051
policies=200
mean18519.356-18442.194=77.162
σ0.428-0.531=-0.103
min18518.990-18441.876=77.113
max18519.973-18442.987=76.986
mean8400.000
σ0.000
min8400.000
max8400.000
mean2659.000-2792.000=-133.000
σ0.000
min2659.000-2792.000=-133.000
max2659.000-2792.000=-133.000
mean28.817-28.918=-0.101
σ0.094-0.077=0.017
min28.712-28.855=-0.143
max28.941-29.024=-0.083