Compare commits

Home / Compare c541467b .. aa474404

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.729-70.730=-0.000
σ0.052-0.052=-0.001
min70.698-70.694=0.003
max70.873-70.874=-0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.158-0.160=-0.002
σ0.005-0.003=0.001
min0.155-0.157=-0.002
max0.169-0.167=0.002
cache=y
dps=1
iters=10
policies=100
mean21.446-21.445=0.001
σ0.003-0.003=-0.000
min21.442-21.440=0.002
max21.452-21.450=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.065-0.062=0.003
σ0.002-0.003=-0.001
min0.064-0.059=0.004
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.285-1755.285=-0.000
σ0.361-0.362=-0.001
min1754.719-1754.723=-0.004
max1755.864-1755.867=-0.003
mean1653.000-1653.150=-0.150
σ626.259-639.588=-13.329
min620.000-622.000=-2.000
max2728.000-2845.000=-117.000
mean2.782-2.783=-0.001
σ0.200-0.195=0.005
min2.195-2.288=-0.093
max2.990-3.003=-0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.768-272.767=0.001
σ0.006-0.011=-0.005
min272.758-272.756=0.002
max272.774-272.781=-0.006
mean2728.000-2845.000=-117.000
σ0.000
min2728.000-2845.000=-117.000
max2728.000-2845.000=-117.000
mean0.385-0.389=-0.003
σ0.004-0.008=-0.004
min0.381-0.380=0.001
max0.391-0.400=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1933.165-1933.156=0.009
σ0.012-0.015=-0.003
min1933.147-1933.133=0.014
max1933.176-1933.172=0.004
mean2728.000-2845.000=-117.000
σ0.000
min2728.000-2845.000=-117.000
max2728.000-2845.000=-117.000
mean3.051-2.958=0.093
σ0.070-0.141=-0.072
min2.971-2.723=0.248
max3.154-3.100=0.054
iters=5
new-facts=6402
prior-facts=1
mean4753.444-4753.666=-0.222
σ1.155-1.012=0.143
min4752.481-4752.901=-0.420
max4755.411-4755.400=0.010
mean2728.000-2845.000=-117.000
σ0.000
min2728.000-2845.000=-117.000
max2728.000-2845.000=-117.000
mean8.529-8.540=-0.010
σ0.485-0.441=0.044
min7.841-7.872=-0.031
max9.097-9.036=0.061
iters=5
new-facts=6402
prior-facts=6402
mean4944.312-4944.380=-0.068
σ0.144-0.016=0.128
min4944.056-4944.360=-0.304
max4944.405-4944.404=0.002
mean2985.400-3027.600=-42.200
σ307.288-263.509=43.779
min2728.000-2845.000=-117.000
max3434.000-3456.000=-22.000
mean8.350-8.469=-0.119
σ0.071-0.124=-0.053
min8.244-8.313=-0.069
max8.440-8.659=-0.219

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.092-1.027=0.065
σ0.181-0.141=0.040
min0.916-0.933=-0.017
max1.312-1.256=0.057

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.844-472.843=0.001
σ574.940-574.926=0.014
min185.365-185.379=-0.013
max1335.254-1335.233=0.021
mean88.250
σ8.500
min84.000
max101.000
mean2728.000-2845.000=-117.000
σ0.000
min2728.000-2845.000=-117.000
max2728.000-2845.000=-117.000
mean0.559-0.488=0.071
σ0.547-0.373=0.174
min0.284-0.300=-0.016
max1.380-1.048=0.332
policies=20
mean1853.989-1854.016=-0.028
σ0.379-0.371=0.008
min1853.728-1853.734=-0.006
max1854.549-1854.554=-0.006
mean840.000
σ0.000
min840.000
max840.000
mean2728.000-2845.000=-117.000
σ0.000
min2728.000-2845.000=-117.000
max2728.000-2845.000=-117.000
mean2.874-2.965=-0.091
σ0.029-0.007=0.021
min2.842-2.957=-0.114
max2.905-2.973=-0.068
policies=200
mean18546.705-18546.632=0.073
σ0.395-0.439=-0.044
min18546.416-18546.257=0.159
max18547.289-18547.253=0.036
mean8400.000
σ0.000
min8400.000
max8400.000
mean2728.000-2845.000=-117.000
σ0.000
min2728.000-2845.000=-117.000
max2728.000-2845.000=-117.000
mean28.866-29.398=-0.532
σ0.152-0.498=-0.347
min28.742-28.913=-0.171
max29.079-29.953=-0.874