Compare commits

Home / Compare c549af9a .. c87fa0ed

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.697-70.695=0.002
σ0.050-0.047=0.003
min70.665-70.667=-0.002
max70.837-70.827=0.010
mean414.000-414.200=-0.200
σ0.000-0.422=-0.422
min414.000
max414.000-415.000=-1.000
mean0.161-0.157=0.004
σ0.003-0.004=-0.001
min0.159-0.150=0.008
max0.166-0.163=0.003
cache=y
dps=1
iters=10
policies=100
mean21.423-21.423=-0.000
σ0.011-0.012=-0.001
min21.415-21.417=-0.002
max21.453-21.457=-0.004
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.063-0.063=0.001
σ0.004-0.003=0.000
min0.060-0.059=0.001
max0.073-0.069=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.459-1754.457=0.002
σ0.360-0.362=-0.002
min1753.892-1753.891=0.000
max1755.035-1755.047=-0.011
mean1645.550-1662.200=-16.650
σ633.043-633.155=-0.112
min614.000-670.000=-56.000
max2772.000-2687.000=85.000
mean2.863-2.788=0.075
σ0.174-0.212=-0.038
min2.304-2.234=0.071
max3.215-3.057=0.158

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.498-273.502=-0.004
σ0.006-0.004=0.002
min273.493-273.498=-0.004
max273.508-273.507=0.001
mean2772.000-2687.000=85.000
σ0.000
min2772.000-2687.000=85.000
max2772.000-2687.000=85.000
mean0.374-0.374=-0.000
σ0.003-0.001=0.002
min0.371-0.372=-0.001
max0.378-0.375=0.003
iters=5
new-facts=1
prior-facts=6402
mean1933.887-1933.891=-0.004
σ0.012-0.020=-0.008
min1933.868-1933.865=0.003
max1933.899-1933.913=-0.014
mean2772.000-2687.000=85.000
σ0.000
min2772.000-2687.000=85.000
max2772.000-2687.000=85.000
mean2.928-2.975=-0.047
σ0.101-0.162=-0.061
min2.808-2.710=0.098
max3.083-3.108=-0.025
iters=5
new-facts=6402
prior-facts=1
mean4754.639-4754.605=0.034
σ0.889-0.892=-0.003
min4754.165-4754.167=-0.002
max4756.225-4756.200=0.026
mean2772.000-2687.000=85.000
σ0.000
min2772.000-2687.000=85.000
max2772.000-2687.000=85.000
mean8.792-8.883=-0.090
σ0.214-0.107=0.107
min8.493-8.704=-0.211
max9.042-8.986=0.057
iters=5
new-facts=6402
prior-facts=6402
mean4945.118-4945.124=-0.006
σ0.018-0.018=0.001
min4945.098-4945.109=-0.011
max4945.138-4945.144=-0.006
mean3010.000-2961.800=48.200
σ295.079-262.639=32.440
min2772.000-2687.000=85.000
max3463.000-3361.000=102.000
mean8.376-8.431=-0.055
σ0.046-0.130=-0.085
min8.329-8.329=-0.000
max8.425-8.603=-0.178

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.143=-0.067
σ0.113-0.118=-0.006
min0.937-1.055=-0.117
max1.252-1.291=-0.039

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.061-473.063=-0.001
σ575.929-575.930=-0.000
min185.090-185.090=0.000
max1336.955-1336.957=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2772.000-2687.000=85.000
σ0.000
min2772.000-2687.000=85.000
max2772.000-2687.000=85.000
mean0.451-0.560=-0.109
σ0.299-0.547=-0.247
min0.298-0.286=0.012
max0.900-1.380=-0.480
policies=20
mean1851.283-1851.261=0.022
σ0.382-0.380=0.001
min1851.018-1851.002=0.016
max1851.845-1851.823=0.023
mean840.000
σ0.000
min840.000
max840.000
mean2772.000-2687.000=85.000
σ0.000
min2772.000-2687.000=85.000
max2772.000-2687.000=85.000
mean2.919-2.873=0.046
σ0.086-0.011=0.075
min2.846-2.863=-0.017
max3.043-2.883=0.160
policies=200
mean18519.363-18519.354=0.009
σ0.448-0.522=-0.074
min18519.052-18518.973=0.079
max18520.026-18520.116=-0.090
mean8400.000
σ0.000
min8400.000
max8400.000
mean2772.000-2687.000=85.000
σ0.000
min2772.000-2687.000=85.000
max2772.000-2687.000=85.000
mean28.829-28.872=-0.044
σ0.057-0.104=-0.047
min28.764-28.729=0.035
max28.893-28.975=-0.082