Compare commits

Home / Compare d89ee446 .. b146bb4b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.001
σ0.109-0.106=0.003
min35.751-35.751=-0.001
max36.106-36.099=0.007
mean417.000-411.900=5.100
σ0.000-0.316=-0.316
min417.000-411.000=6.000
max417.000-412.000=5.000
mean0.077-0.075=0.002
σ0.005-0.003=0.001
min0.074-0.071=0.003
max0.085-0.082=0.003
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.001
σ0.003-0.004=-0.001
min26.061-26.058=0.003
max26.071-26.069=0.002
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.061-0.059=0.001
σ0.003-0.003=0.000
min0.056-0.057=-0.001
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.921-1755.923=-0.002
σ0.365-0.368=-0.003
min1755.349-1755.351=-0.003
max1756.496-1756.514=-0.018
mean1669.700-1663.250=6.450
σ635.039-640.619=-5.581
min669.000-610.000=59.000
max2632.000-2707.000=-75.000
mean2.804-2.886=-0.082
σ0.194-0.109=0.085
min2.200-2.625=-0.426
max3.025-3.114=-0.089

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.193-277.198=-0.005
σ0.005-0.012=-0.007
min277.187-277.179=0.008
max277.198-277.208=-0.010
mean2632.000-2707.000=-75.000
σ0.000
min2632.000-2707.000=-75.000
max2632.000-2707.000=-75.000
mean0.393-0.408=-0.015
σ0.002-0.009=-0.007
min0.390-0.403=-0.013
max0.394-0.423=-0.029
iters=5
new-facts=1
prior-facts=6402
mean2174.418-2174.427=-0.010
σ0.050-0.020=0.030
min2174.342-2174.393=-0.051
max2174.480-2174.442=0.038
mean2632.000-2707.000=-75.000
σ0.000
min2632.000-2707.000=-75.000
max2632.000-2707.000=-75.000
mean2.891-3.077=-0.186
σ0.151-0.150=0.001
min2.756-2.889=-0.133
max3.099-3.285=-0.186
iters=5
new-facts=6402
prior-facts=1
mean5052.602-5052.632=-0.031
σ0.973-0.988=-0.014
min5052.014-5052.035=-0.020
max5054.335-5054.386=-0.051
mean2632.000-2707.000=-75.000
σ0.000
min2632.000-2707.000=-75.000
max2632.000-2707.000=-75.000
mean8.818-8.737=0.082
σ0.599-0.533=0.066
min7.991-8.293=-0.302
max9.464-9.574=-0.110
iters=5
new-facts=6402
prior-facts=6402
mean5188.428-5188.357=0.071
σ0.089-0.200=-0.111
min5188.352-5188.030=0.323
max5188.528-5188.523=0.006
mean3200.000-3222.600=-22.600
σ475.163-372.707=102.456
min2632.000-2707.000=-75.000
max3834.000-3693.000=141.000
mean8.729-8.831=-0.103
σ0.181-0.285=-0.104
min8.626-8.583=0.043
max9.050-9.316=-0.267

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.263-1.089=0.175
σ0.338-0.145=0.192
min0.938-0.945=-0.007
max1.790-1.240=0.550

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.863-464.858=0.005
σ572.669-572.654=0.015
min178.526-178.523=0.003
max1323.867-1323.840=0.027
mean79.500
σ7.000
min76.000
max90.000
mean2632.000-2707.000=-75.000
σ0.000
min2632.000-2707.000=-75.000
max2632.000-2707.000=-75.000
mean0.567-0.549=0.018
σ0.567-0.525=0.042
min0.281-0.280=0.000
max1.417-1.336=0.081
policies=20
mean1785.469-1785.485=-0.016
σ0.343-0.352=-0.009
min1785.243-1785.250=-0.007
max1785.979-1786.008=-0.029
mean760.000
σ0.000
min760.000
max760.000
mean2632.000-2707.000=-75.000
σ0.000
min2632.000-2707.000=-75.000
max2632.000-2707.000=-75.000
mean2.786-2.786=-0.000
σ0.016-0.025=-0.009
min2.774-2.754=0.020
max2.810-2.813=-0.004
policies=200
mean17861.220-17861.551=-0.331
σ0.534-0.523=0.011
min17860.918-17861.286=-0.368
max17862.020-17862.336=-0.316
mean7600.000
σ0.000
min7600.000
max7600.000
mean2632.000-2707.000=-75.000
σ0.000
min2632.000-2707.000=-75.000
max2632.000-2707.000=-75.000
mean28.253-28.304=-0.052
σ0.127-0.228=-0.101
min28.143-28.121=0.022
max28.395-28.633=-0.238