Compare commits

Home / Compare 8bb0a9b6 .. 987476cf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.729-70.730=-0.002
σ0.048-0.051=-0.003
min70.705-70.702=0.003
max70.862-70.873=-0.011
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.158-0.160=-0.002
σ0.004-0.006=-0.002
min0.155-0.150=0.005
max0.164-0.170=-0.007
cache=y
dps=1
iters=10
policies=100
mean21.446-21.450=-0.003
σ0.003-0.011=-0.008
min21.442-21.442=-0.000
max21.451-21.481=-0.029
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.065-0.064=0.001
σ0.003-0.005=-0.002
min0.063-0.058=0.005
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.527=-0.000
σ0.360-0.359=0.001
min1753.957-1753.963=-0.005
max1755.118-1755.112=0.006
mean1659.350-1651.150=8.200
σ638.720-626.060=12.660
min641.000-619.000=22.000
max2838.000-2645.000=193.000
mean2.826-2.836=-0.010
σ0.186-0.168=0.017
min2.366-2.574=-0.207
max3.255-3.203=0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.607-273.606=0.001
σ0.006-0.007=-0.002
min273.600-273.594=0.007
max273.615-273.614=0.001
mean2838.000-2645.000=193.000
σ0.000
min2838.000-2645.000=193.000
max2838.000-2645.000=193.000
mean0.383-0.383=0.000
σ0.006-0.007=-0.000
min0.380-0.379=0.001
max0.395-0.395=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1933.995-1934.008=-0.014
σ0.013-0.007=0.006
min1933.979-1934.000=-0.021
max1934.015-1934.015=-0.000
mean2838.000-2645.000=193.000
σ0.000
min2838.000-2645.000=193.000
max2838.000-2645.000=193.000
mean2.962-3.028=-0.066
σ0.114-0.138=-0.024
min2.769-2.921=-0.152
max3.068-3.270=-0.202
iters=5
new-facts=6402
prior-facts=1
mean4754.619-4754.652=-0.032
σ0.647-0.933=-0.286
min4754.208-4753.738=0.469
max4755.762-4756.228=-0.466
mean2838.000-2645.000=193.000
σ0.000
min2838.000-2645.000=193.000
max2838.000-2645.000=193.000
mean8.857-8.440=0.417
σ0.451-0.520=-0.069
min8.263-7.617=0.646
max9.449-8.894=0.555
iters=5
new-facts=6402
prior-facts=6402
mean4945.230-4945.225=0.005
σ0.020-0.017=0.003
min4945.210-4945.207=0.002
max4945.255-4945.243=0.011
mean3015.600-3008.200=7.400
σ196.048-285.187=-89.139
min2838.000-2645.000=193.000
max3314.000-3374.000=-60.000
mean8.659-8.600=0.060
σ0.117-0.238=-0.121
min8.560-8.389=0.171
max8.856-8.979=-0.123

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.257=-0.193
σ0.165-0.340=-0.175
min0.943-0.934=0.009
max1.245-1.821=-0.575

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.865-472.865=-0.000
σ574.940-574.936=0.004
min185.391-185.392=-0.001
max1335.275-1335.270=0.006
mean88.250
σ8.500
min84.000
max101.000
mean2838.000-2645.000=193.000
σ0.000
min2838.000-2645.000=193.000
max2838.000-2645.000=193.000
mean0.496-0.576=-0.080
σ0.375-0.579=-0.203
min0.304-0.284=0.020
max1.059-1.444=-0.384
policies=20
mean1854.249-1854.207=0.042
σ0.372-0.388=-0.016
min1853.970-1853.937=0.033
max1854.786-1854.779=0.006
mean840.000
σ0.000
min840.000
max840.000
mean2838.000-2645.000=193.000
σ0.000
min2838.000-2645.000=193.000
max2838.000-2645.000=193.000
mean2.954-2.863=0.091
σ0.005-0.012=-0.007
min2.949-2.848=0.101
max2.961-2.878=0.083
policies=200
mean18549.052-18548.972=0.080
σ0.396-0.410=-0.014
min18548.825-18548.681=0.144
max18549.644-18549.574=0.070
mean8400.000
σ0.000
min8400.000
max8400.000
mean2838.000-2645.000=193.000
σ0.000
min2838.000-2645.000=193.000
max2838.000-2645.000=193.000
mean29.166-28.813=0.353
σ0.425-0.089=0.336
min28.824-28.682=0.142
max29.706-28.873=0.833