Compare commits

Home / Compare ccd97667 .. f09ec5ba

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.916-53.917=-0.001
σ0.366-0.368=-0.002
min53.791-53.792=-0.001
max54.958-54.964=-0.006
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.141-0.146=-0.005
σ0.010-0.011=-0.001
min0.130-0.136=-0.006
max0.161-0.167=-0.006
cache=y
dps=1
iters=10
policies=100
mean43.144-43.141=0.003
σ0.011-0.007=0.005
min43.131-43.130=0.001
max43.169-43.153=0.017
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.131-0.120=0.011
σ0.011-0.003=0.008
min0.119-0.117=0.002
max0.147-0.127=0.020

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.068-992.078=-0.011
σ1.215-1.231=-0.016
min991.496-991.496=-0.000
max997.177-997.251=-0.074
mean1064.700-1064.300=0.400
σ319.527-321.523=-1.996
min567.000-602.000=-35.000
max1645.000-1635.000=10.000
mean1.497-1.558=-0.061
σ0.064-0.140=-0.076
min1.352-1.416=-0.064
max1.637-1.998=-0.361

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.675-285.675=0.000
σ0.013-0.014=-0.001
min285.657-285.653=0.003
max285.691-285.686=0.006
mean1645.000-1635.000=10.000
σ0.000
min1645.000-1635.000=10.000
max1645.000-1635.000=10.000
mean0.375-0.379=-0.004
σ0.002-0.008=-0.006
min0.374-0.373=0.000
max0.379-0.393=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1285.637-1285.642=-0.005
σ0.129-0.134=-0.005
min1285.576-1285.580=-0.005
max1285.868-1285.881=-0.013
mean1645.000-1635.000=10.000
σ0.000
min1645.000-1635.000=10.000
max1645.000-1635.000=10.000
mean1.874-1.927=-0.054
σ0.023-0.141=-0.118
min1.847-1.819=0.028
max1.908-2.167=-0.260
iters=5
new-facts=6402
prior-facts=1
mean1807.974-1807.970=0.004
σ7.012-7.015=-0.003
min1804.615-1804.614=0.000
max1820.502-1820.504=-0.002
mean1645.000-1635.000=10.000
σ0.000
min1645.000-1635.000=10.000
max1645.000-1635.000=10.000
mean4.202-4.168=0.034
σ0.214-0.205=0.010
min3.981-3.966=0.015
max4.468-4.423=0.045
iters=5
new-facts=6402
prior-facts=6402
mean2070.463-2070.467=-0.004
σ0.012-0.007=0.006
min2070.450-2070.460=-0.010
max2070.483-2070.478=0.006
mean1862.200-1835.400=26.800
σ198.375-174.456=23.919
min1645.000-1635.000=10.000
max2092.000-2072.000=20.000
mean4.524-4.540=-0.016
σ0.104-0.033=0.071
min4.426-4.498=-0.072
max4.653-4.587=0.066

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.218-1.296=-0.078
σ0.368-0.353=0.015
min0.911-0.904=0.007
max1.839-1.705=0.133

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.384-437.382=0.002
σ572.363-572.362=0.001
min151.194-151.196=-0.001
max1295.928-1295.925=0.003
mean90.250
σ8.500
min86.000
max103.000
mean1645.000-1635.000=10.000
σ0.000
min1645.000-1635.000=10.000
max1645.000-1635.000=10.000
mean0.510-0.553=-0.043
σ0.515-0.592=-0.077
min0.251-0.253=-0.002
max1.283-1.442=-0.159
policies=20
mean1512.212-1512.205=0.007
σ0.247-0.246=0.001
min1512.052-1512.042=0.010
max1512.580-1512.571=0.009
mean860.000
σ0.000
min860.000
max860.000
mean1645.000-1635.000=10.000
σ0.000
min1645.000-1635.000=10.000
max1645.000-1635.000=10.000
mean2.530-2.526=0.004
σ0.013-0.018=-0.006
min2.519-2.503=0.016
max2.545-2.546=-0.000
policies=200
mean15129.711-15129.691=0.020
σ0.071-0.069=0.002
min15129.617-15129.612=0.005
max15129.786-15129.780=0.006
mean8600.000
σ0.000
min8600.000
max8600.000
mean1645.000-1635.000=10.000
σ0.000
min1645.000-1635.000=10.000
max1645.000-1635.000=10.000
mean25.548-25.677=-0.129
σ0.128-0.241=-0.114
min25.416-25.447=-0.031
max25.665-25.994=-0.329