Compare commits

Home / Compare b7913ed9 .. 571e2b52

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.263=0.001
σ0.054-0.055=-0.001
min35.237-35.230=0.006
max35.416-35.416=-0.001
mean413.000-412.200=0.800
σ0.000-0.632=-0.632
min413.000-412.000=1.000
max413.000-414.000=-1.000
mean0.085-0.083=0.003
σ0.003-0.005=-0.002
min0.082-0.076=0.006
max0.092-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.004-0.002=0.002
min23.767-23.766=0.001
max23.778-23.772=0.006
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.067-0.067=0.000
σ0.006-0.004=0.001
min0.062-0.061=0.001
max0.077-0.076=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.483-1756.485=-0.002
σ0.365-0.366=-0.001
min1755.907-1755.909=-0.002
max1757.067-1757.073=-0.006
mean1644.550-1626.700=17.850
σ646.026-592.729=53.296
min620.000-650.000=-30.000
max2728.000-2424.000=304.000
mean2.374-2.327=0.047
σ0.131-0.082=0.049
min2.136-2.175=-0.039
max2.632-2.512=0.120

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.716-324.714=0.001
σ0.024-0.034=-0.009
min324.672-324.654=0.018
max324.732-324.735=-0.003
mean2728.000-2424.000=304.000
σ0.000
min2728.000-2424.000=304.000
max2728.000-2424.000=304.000
mean0.423-0.423=0.000
σ0.001-0.001=-0.000
min0.421-0.421=0.000
max0.425-0.425=0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.262-1985.267=-0.005
σ0.026-0.013=0.012
min1985.220-1985.243=-0.023
max1985.281-1985.273=0.009
mean2728.000-2424.000=304.000
σ0.000
min2728.000-2424.000=304.000
max2728.000-2424.000=304.000
mean2.616-2.606=0.009
σ0.074-0.084=-0.010
min2.575-2.513=0.062
max2.747-2.733=0.013
iters=5
new-facts=6402
prior-facts=1
mean4808.871-4808.858=0.013
σ7.734-7.668=0.066
min4805.377-4805.415=-0.038
max4822.705-4822.575=0.130
mean2728.000-2424.000=304.000
σ0.000
min2728.000-2424.000=304.000
max2728.000-2424.000=304.000
mean9.070-8.843=0.228
σ0.237-0.108=0.128
min8.857-8.747=0.110
max9.463-9.019=0.444
iters=5
new-facts=6402
prior-facts=6402
mean4996.469-4996.324=0.145
σ0.009-0.202=-0.192
min4996.456-4996.089=0.367
max4996.478-4996.479=-0.001
mean3026.600-2948.200=78.400
σ352.038-440.902=-88.864
min2728.000-2424.000=304.000
max3544.000-3535.000=9.000
mean8.588-8.502=0.086
σ0.117-0.064=0.053
min8.469-8.430=0.039
max8.725-8.599=0.126

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.977-1.672=-0.695
σ0.069-0.082=-0.013
min0.915-1.557=-0.643
max1.054-1.769=-0.716

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.967-462.948=0.019
σ574.277-574.246=0.031
min175.818-175.819=-0.000
max1324.382-1324.317=0.065
mean86.250
σ8.500
min82.000
max99.000
mean2728.000-2424.000=304.000
σ0.000
min2728.000-2424.000=304.000
max2728.000-2424.000=304.000
mean0.483-0.546=-0.063
σ0.412-0.541=-0.128
min0.269-0.273=-0.004
max1.101-1.357=-0.256
policies=20
mean1758.524-1758.525=-0.001
σ0.340-0.345=-0.005
min1758.284-1758.289=-0.006
max1759.026-1759.035=-0.009
mean820.000
σ0.000
min820.000
max820.000
mean2728.000-2424.000=304.000
σ0.000
min2728.000-2424.000=304.000
max2728.000-2424.000=304.000
mean2.722-2.715=0.007
σ0.020-0.013=0.007
min2.699-2.700=-0.000
max2.742-2.731=0.011
policies=200
mean17592.388-17592.225=0.163
σ0.456-0.680=-0.224
min17591.977-17591.480=0.497
max17593.040-17593.117=-0.077
mean8200.000
σ0.000
min8200.000
max8200.000
mean2728.000-2424.000=304.000
σ0.000
min2728.000-2424.000=304.000
max2728.000-2424.000=304.000
mean27.428-27.378=0.050
σ0.109-0.110=-0.002
min27.305-27.235=0.071
max27.550-27.499=0.051