Compare commits

Home / Compare 883bacee .. 0c10e49a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-30.959=0.082
σ0.048-0.047=0.001
min31.001-30.918=0.082
max31.173-31.088=0.085
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.079-0.079=-0.000
σ0.002-0.004=-0.001
min0.077-0.075=0.002
max0.085-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.061=0.081
σ0.003-0.002=0.001
min21.139-21.058=0.082
max21.147-21.064=0.083
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.064-0.061=0.003
σ0.004-0.003=0.001
min0.058-0.056=0.001
max0.071-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.412=-0.001
σ0.363-0.361=0.002
min1750.838-1750.846=-0.008
max1751.995-1751.995=0.001
mean1647.950-1636.600=11.350
σ628.474-613.053=15.421
min628.000-654.000=-26.000
max2849.000-2465.000=384.000
mean2.831-2.777=0.054
σ0.096-0.222=-0.126
min2.627-2.196=0.431
max3.066-3.226=-0.160

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.643-273.403=-1.760
σ0.004-0.009=-0.006
min271.639-273.392=-1.753
max271.648-273.414=-1.767
mean2849.000-2465.000=384.000
σ0.000
min2849.000-2465.000=384.000
max2849.000-2465.000=384.000
mean0.384-0.388=-0.004
σ0.009-0.009=-0.000
min0.377-0.379=-0.002
max0.397-0.401=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.112-1933.837=-1.726
σ0.007-0.013=-0.006
min1932.100-1933.818=-1.717
max1932.117-1933.854=-1.737
mean2849.000-2465.000=384.000
σ0.000
min2849.000-2465.000=384.000
max2849.000-2465.000=384.000
mean2.573-2.953=-0.380
σ0.195-0.193=0.002
min2.429-2.734=-0.305
max2.913-3.225=-0.312
iters=5
new-facts=6402
prior-facts=1
mean4752.642-4754.356=-1.714
σ0.770-0.797=-0.027
min4752.244-4753.840=-1.596
max4754.017-4755.771=-1.754
mean2849.000-2465.000=384.000
σ0.000
min2849.000-2465.000=384.000
max2849.000-2465.000=384.000
mean8.080-8.482=-0.402
σ0.272-0.367=-0.095
min7.719-7.863=-0.144
max8.397-8.772=-0.375
iters=5
new-facts=6402
prior-facts=6402
mean4943.041-4944.801=-1.761
σ0.080-0.100=-0.020
min4942.961-4944.708=-1.747
max4943.128-4944.923=-1.795
mean3055.000-3045.000=10.000
σ266.493-386.578=-120.085
min2849.000-2489.000=360.000
max3462.000-3399.000=63.000
mean8.414-8.739=-0.325
σ0.104-0.423=-0.319
min8.345-8.332=0.012
max8.588-9.426=-0.838

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.808=-0.733
σ0.107-0.111=-0.004
min0.938-1.693=-0.756
max1.239-1.989=-0.750

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.124-463.332=1.792
σ575.762-572.193=3.570
min177.233-177.235=-0.002
max1328.767-1321.621=7.147
mean79.750
σ7.500
min76.000
max91.000
mean2849.000-2465.000=384.000
σ0.000
min2849.000-2465.000=384.000
max2849.000-2465.000=384.000
mean0.443-0.504=-0.062
σ0.312-0.442=-0.130
min0.283-0.280=0.003
max0.910-1.167=-0.257
policies=20
mean1772.618-1772.588=0.030
σ0.333-0.337=-0.005
min1772.374-1772.362=0.012
max1773.106-1773.088=0.018
mean760.000
σ0.000
min760.000
max760.000
mean2849.000-2465.000=384.000
σ0.000
min2849.000-2465.000=384.000
max2849.000-2465.000=384.000
mean2.831-2.739=0.092
σ0.011-0.025=-0.014
min2.818-2.714=0.103
max2.845-2.770=0.075
policies=200
mean17732.450-17732.392=0.058
σ0.455-0.590=-0.136
min17731.993-17732.030=-0.037
max17733.079-17733.271=-0.191
mean7600.000
σ0.000
min7600.000
max7600.000
mean2849.000-2465.000=384.000
σ0.000
min2849.000-2465.000=384.000
max2849.000-2465.000=384.000
mean28.173-27.604=0.569
σ0.425-0.062=0.363
min27.639-27.550=0.089
max28.559-27.672=0.887