Compare commits

Home / Compare 3c6486fd .. b4bef438

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.127-70.396=2.732
σ0.051-0.044=0.007
min73.100-70.372=2.728
max73.270-70.518=2.752
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.160-0.156=0.004
σ0.004-0.005=-0.000
min0.152-0.149=0.003
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean23.755-21.144=2.610
σ0.003-0.002=0.001
min23.751-21.141=2.610
max23.762-21.148=2.614
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.066-0.064=0.002
σ0.005-0.003=0.001
min0.061-0.060=0.002
max0.075-0.072=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.822-1752.395=3.426
σ0.362-0.361=0.001
min1755.249-1751.823=3.426
max1756.422-1752.973=3.449
mean1643.300-1625.650=17.650
σ605.159-592.621=12.538
min625.000-646.000=-21.000
max2466.000-2414.000=52.000
mean2.810-2.824=-0.014
σ0.112-0.107=0.004
min2.526-2.618=-0.092
max2.975-3.003=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean321.044-270.239=50.805
σ0.052-0.008=0.044
min320.952-270.227=50.725
max321.075-270.247=50.828
mean2466.000-2414.000=52.000
σ0.000
min2466.000-2414.000=52.000
max2466.000-2414.000=52.000
mean0.421-0.380=0.042
σ0.001-0.006=-0.005
min0.420-0.371=0.049
max0.422-0.387=0.035
iters=5
new-facts=1
prior-facts=6402
mean1981.630-1930.702=50.928
σ0.005-0.012=-0.006
min1981.623-1930.687=50.936
max1981.637-1930.717=50.920
mean2466.000-2414.000=52.000
σ0.000
min2466.000-2414.000=52.000
max2466.000-2414.000=52.000
mean2.621-2.565=0.056
σ0.075-0.128=-0.053
min2.572-2.463=0.109
max2.741-2.779=-0.038
iters=5
new-facts=6402
prior-facts=1
mean4805.256-4751.374=53.881
σ7.710-0.872=6.838
min4801.781-4750.898=50.883
max4819.047-4752.930=66.117
mean2466.000-2414.000=52.000
σ0.000
min2466.000-2414.000=52.000
max2466.000-2414.000=52.000
mean8.681-8.688=-0.007
σ0.102-0.260=-0.159
min8.552-8.435=0.117
max8.825-9.059=-0.234
iters=5
new-facts=6402
prior-facts=6402
mean4992.832-4941.872=50.960
σ0.015-0.018=-0.004
min4992.819-4941.842=50.977
max4992.850-4941.890=50.960
mean2979.600-2975.800=3.800
σ286.049-268.029=18.020
min2596.000-2624.000=-28.000
max3320.000-3318.000=2.000
mean8.654-8.602=0.052
σ0.129-0.317=-0.188
min8.517-8.385=0.132
max8.843-9.163=-0.320

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.713-1.794=-0.081
σ0.104-0.118=-0.014
min1.605-1.607=-0.002
max1.825-1.919=-0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.402-466.749=-4.346
σ574.243-575.924=-1.680
min175.275-178.782=-3.507
max1323.767-1330.634=-6.867
mean86.250
σ8.500
min82.000
max99.000
mean2466.000-2414.000=52.000
σ0.000
min2466.000-2414.000=52.000
max2466.000-2414.000=52.000
mean0.534-0.563=-0.028
σ0.533-0.565=-0.032
min0.266-0.279=-0.013
max1.334-1.410=-0.076
policies=20
mean1753.051-1788.107=-35.056
σ0.359-0.372=-0.013
min1752.837-1787.869=-35.032
max1753.589-1788.661=-35.073
mean820.000
σ0.000
min820.000
max820.000
mean2466.000-2414.000=52.000
σ0.000
min2466.000-2414.000=52.000
max2466.000-2414.000=52.000
mean2.730-2.797=-0.068
σ0.015-0.012=0.003
min2.716-2.783=-0.066
max2.749-2.811=-0.062
policies=200
mean17537.646-17888.092=-350.445
σ0.433-0.373=0.059
min17537.140-17887.845=-350.705
max17538.196-17888.643=-350.447
mean8200.000
σ0.000
min8200.000
max8200.000
mean2466.000-2414.000=52.000
σ0.000
min2466.000-2414.000=52.000
max2466.000-2414.000=52.000
mean27.415-27.985=-0.570
σ0.105-0.149=-0.044
min27.306-27.776=-0.470
max27.558-28.124=-0.566