Compare commits

Home / Compare ef336574 .. d7eb4c9c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.687-70.687=0.000
σ0.044-0.047=-0.003
min70.664-70.663=0.001
max70.811-70.820=-0.009
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.164-0.162=0.002
σ0.010-0.003=0.007
min0.156-0.159=-0.002
max0.188-0.167=0.020
cache=y
dps=1
iters=10
policies=100
mean21.421-21.420=0.001
σ0.003-0.002=0.000
min21.416-21.417=-0.001
max21.425-21.424=0.001
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.066-0.065=0.000
σ0.002-0.002=0.000
min0.064-0.064=0.000
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.460-1754.458=0.001
σ0.362-0.360=0.001
min1753.889-1753.888=0.001
max1755.046-1755.043=0.003
mean1673.800-1668.900=4.900
σ648.749-654.277=-5.528
min627.000-638.000=-11.000
max2868.000-2866.000=2.000
mean2.754-2.821=-0.067
σ0.192-0.195=-0.003
min2.132-2.183=-0.051
max2.949-3.064=-0.115

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.508-273.506=0.002
σ0.006-0.010=-0.004
min273.500-273.490=0.010
max273.517-273.518=-0.001
mean2868.000-2866.000=2.000
σ0.000
min2868.000-2866.000=2.000
max2868.000-2866.000=2.000
mean0.385-0.378=0.007
σ0.003-0.004=-0.001
min0.382-0.374=0.008
max0.390-0.385=0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.886-1933.897=-0.012
σ0.033-0.005=0.028
min1933.829-1933.891=-0.062
max1933.912-1933.902=0.010
mean2868.000-2866.000=2.000
σ0.000
min2868.000-2866.000=2.000
max2868.000-2866.000=2.000
mean3.050-2.986=0.064
σ0.113-0.182=-0.069
min2.930-2.679=0.251
max3.197-3.151=0.046
iters=5
new-facts=6402
prior-facts=1
mean4754.661-4754.394=0.266
σ0.845-0.766=0.079
min4754.109-4753.580=0.529
max4756.152-4755.664=0.488
mean2868.000-2866.000=2.000
σ0.000
min2868.000-2866.000=2.000
max2868.000-2866.000=2.000
mean8.551-8.851=-0.300
σ0.638-0.190=0.448
min7.692-8.613=-0.921
max9.339-9.113=0.226
iters=5
new-facts=6402
prior-facts=6402
mean4945.040-4945.045=-0.005
σ0.163-0.175=-0.012
min4944.750-4944.734=0.016
max4945.136-4945.142=-0.006
mean3067.600-3064.800=2.800
σ210.377-182.211=28.166
min2868.000-2866.000=2.000
max3377.000-3325.000=52.000
mean8.656-8.643=0.013
σ0.256-0.205=0.050
min8.440-8.429=0.011
max9.062-8.950=0.111

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.170-1.017=0.153
σ0.308-0.124=0.184
min0.945-0.924=0.021
max1.569-1.213=0.355

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.570-472.561=0.009
σ574.942-574.931=0.011
min185.090-185.089=0.001
max1334.984-1334.958=0.026
mean88.250
σ8.500
min84.000
max101.000
mean2868.000-2866.000=2.000
σ0.000
min2868.000-2866.000=2.000
max2868.000-2866.000=2.000
mean0.454-0.448=0.006
σ0.299-0.303=-0.004
min0.301-0.291=0.010
max0.903-0.902=0.000
policies=20
mean1851.268-1851.272=-0.004
σ0.379-0.372=0.007
min1850.977-1851.005=-0.028
max1851.816-1851.815=0.001
mean840.000
σ0.000
min840.000
max840.000
mean2868.000-2866.000=2.000
σ0.000
min2868.000-2866.000=2.000
max2868.000-2866.000=2.000
mean2.965-2.950=0.015
σ0.008-0.008=0.001
min2.959-2.942=0.016
max2.977-2.960=0.017
policies=200
mean18519.417-18519.313=0.104
σ0.501-0.418=0.083
min18519.005-18518.968=0.037
max18520.135-18519.920=0.215
mean8400.000
σ0.000
min8400.000
max8400.000
mean2868.000-2866.000=2.000
σ0.000
min2868.000-2866.000=2.000
max2868.000-2866.000=2.000
mean29.230-29.149=0.080
σ0.413-0.524=-0.111
min28.952-28.840=0.112
max29.843-29.933=-0.090