Compare commits

Home / Compare 3c879145 .. e6135308

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.918=-0.003
σ0.368-0.368=-0.001
min53.775-53.788=-0.013
max54.961-54.965=-0.005
mean418.000-415.800=2.200
σ0.000-0.422=-0.422
min418.000-415.000=3.000
max418.000-416.000=2.000
mean0.140-0.147=-0.006
σ0.004-0.008=-0.004
min0.137-0.138=-0.000
max0.147-0.158=-0.011
cache=y
dps=1
iters=10
policies=100
mean43.141-43.140=0.001
σ0.007-0.004=0.003
min43.129-43.134=-0.005
max43.152-43.149=0.003
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.122-0.121=0.002
σ0.003-0.004=-0.000
min0.118-0.115=0.003
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.804-991.814=-0.010
σ1.252-1.247=0.005
min991.256-991.231=0.025
max997.076-997.057=0.019
mean1067.450-1069.650=-2.200
σ321.795-313.529=8.266
min570.000-616.000=-46.000
max1640.000-1651.000=-11.000
mean1.551-1.531=0.020
σ0.100-0.077=0.023
min1.458-1.417=0.041
max1.775-1.738=0.037

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.413=-0.002
σ0.008-0.015=-0.007
min285.398-285.387=0.010
max285.417-285.423=-0.006
mean1640.000-1651.000=-11.000
σ0.000
min1640.000-1651.000=-11.000
max1640.000-1651.000=-11.000
mean0.378-0.384=-0.006
σ0.007-0.016=-0.008
min0.371-0.374=-0.003
max0.386-0.412=-0.026
iters=5
new-facts=1
prior-facts=6402
mean1285.374-1285.374=-0.000
σ0.132-0.139=-0.007
min1285.306-1285.307=-0.001
max1285.610-1285.623=-0.013
mean1640.000-1651.000=-11.000
σ0.000
min1640.000-1651.000=-11.000
max1640.000-1651.000=-11.000
mean1.913-1.927=-0.015
σ0.112-0.141=-0.030
min1.831-1.807=0.024
max2.105-2.115=-0.009
iters=5
new-facts=6402
prior-facts=1
mean1807.703-1807.800=-0.097
σ7.010-6.976=0.034
min1804.338-1804.463=-0.125
max1820.227-1820.266=-0.039
mean1640.000-1651.000=-11.000
σ0.000
min1640.000-1651.000=-11.000
max1640.000-1651.000=-11.000
mean4.181-4.383=-0.202
σ0.183-0.301=-0.118
min3.910-4.081=-0.171
max4.420-4.802=-0.382
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-2070.196=0.001
σ0.012-0.006=0.006
min2070.185-2070.187=-0.003
max2070.216-2070.202=0.014
mean1838.400-1865.800=-27.400
σ169.754-191.127=-21.374
min1640.000-1651.000=-11.000
max2074.000-2081.000=-7.000
mean4.527-4.513=0.015
σ0.031-0.040=-0.009
min4.477-4.475=0.002
max4.556-4.573=-0.016

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.229-1.193=0.036
σ0.243-0.377=-0.134
min0.889-0.921=-0.032
max1.573-1.830=-0.257

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.785=0.000
σ572.362-572.361=0.000
min150.595-150.596=-0.001
max1295.328-1295.327=0.001
mean90.250
σ8.500
min86.000
max103.000
mean1640.000-1651.000=-11.000
σ0.000
min1640.000-1651.000=-11.000
max1640.000-1651.000=-11.000
mean0.505-0.517=-0.011
σ0.512-0.531=-0.019
min0.245-0.250=-0.005
max1.274-1.313=-0.039
policies=20
mean1506.245-1506.254=-0.010
σ0.248-0.237=0.011
min1506.076-1506.102=-0.026
max1506.613-1506.608=0.005
mean860.000
σ0.000
min860.000
max860.000
mean1640.000-1651.000=-11.000
σ0.000
min1640.000-1651.000=-11.000
max1640.000-1651.000=-11.000
mean2.525-2.521=0.005
σ0.013-0.025=-0.013
min2.511-2.488=0.023
max2.538-2.545=-0.007
policies=200
mean15070.266-15070.313=-0.048
σ0.082-0.045=0.038
min15070.155-15070.252=-0.097
max15070.349-15070.355=-0.006
mean8600.000
σ0.000
min8600.000
max8600.000
mean1640.000-1651.000=-11.000
σ0.000
min1640.000-1651.000=-11.000
max1640.000-1651.000=-11.000
mean25.486-25.551=-0.065
σ0.057-0.103=-0.047
min25.407-25.403=0.004
max25.538-25.643=-0.105