Compare commits

Home / Compare 5c7a2d04 .. cbac9519

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.722-36.701=0.021
σ0.632-0.664=-0.032
min35.924-35.925=-0.001
max37.523-37.523=-0.001
mean4084.000-3941.000=143.000
σ0.000
min4084.000-3941.000=143.000
max4084.000-3941.000=143.000
mean0.075-0.076=-0.001
σ0.001-0.002=-0.001
min0.073-0.074=-0.001
max0.076-0.080=-0.004
cache=y
dps=1
iters=10
policies=100
mean26.585-26.585=0.000
σ0.607-0.603=0.003
min26.205-26.206=-0.002
max27.467-27.464=0.003
mean4084.000-3941.000=143.000
σ0.000
min4084.000-3941.000=143.000
max4084.000-3941.000=143.000
mean0.060-0.057=0.003
σ0.001-0.001=-0.000
min0.059-0.056=0.003
max0.061-0.058=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.357-1756.357=0.001
σ0.372-0.371=0.000
min1755.788-1755.784=0.004
max1756.955-1756.948=0.007
mean1655.300-1667.050=-11.750
σ627.034-646.269=-19.235
min681.000-629.000=52.000
max2604.000-2858.000=-254.000
mean2.258-2.268=-0.010
σ0.144-0.151=-0.008
min2.144-2.083=0.060
max2.782-2.817=-0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.672-278.670=0.002
σ0.015-0.012=0.003
min278.657-278.661=-0.004
max278.697-278.690=0.007
mean2604.000-2858.000=-254.000
σ0.000
min2604.000-2858.000=-254.000
max2604.000-2858.000=-254.000
mean0.417-0.417=0.000
σ0.001-0.001=-0.000
min0.417-0.416=0.000
max0.419-0.418=0.000
iters=5
new-facts=1
prior-facts=6402
mean2268.835-2268.847=-0.012
σ0.013-0.006=0.007
min2268.816-2268.841=-0.026
max2268.850-2268.856=-0.006
mean2604.000-2858.000=-254.000
σ0.000
min2604.000-2858.000=-254.000
max2604.000-2858.000=-254.000
mean2.967-3.005=-0.039
σ0.105-0.119=-0.015
min2.893-2.911=-0.018
max3.150-3.166=-0.016
iters=5
new-facts=6402
prior-facts=1
mean4952.325-4952.121=0.204
σ0.924-0.234=0.690
min4951.723-4951.960=-0.237
max4953.965-4952.531=1.434
mean2604.000-2858.000=-254.000
σ0.000
min2604.000-2858.000=-254.000
max2604.000-2858.000=-254.000
mean8.089-7.737=0.351
σ0.514-0.151=0.363
min7.757-7.608=0.149
max8.989-7.924=1.065
iters=5
new-facts=6402
prior-facts=6402
mean5166.985-5167.048=-0.063
σ0.160-0.012=0.148
min5166.699-5167.030=-0.331
max5167.071-5167.063=0.008
mean3368.200-3391.600=-23.400
σ493.587-412.736=80.851
min2772.000-2858.000=-86.000
max4084.000-3941.000=143.000
mean9.330-9.347=-0.017
σ0.313-0.249=0.064
min8.864-9.057=-0.193
max9.688-9.671=0.017

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.059-1.028=0.032
σ0.126-0.140=-0.014
min0.945-0.935=0.011
max1.252-1.255=-0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.253-460.253=-0.000
σ572.607-572.607=0.000
min173.947-173.947=-0.001
max1319.164-1319.164=0.001
mean79.500
σ7.000
min76.000
max90.000
mean436.000-437.000=-1.000
σ0.000
min436.000-437.000=-1.000
max436.000-437.000=-1.000
mean0.520-0.571=-0.051
σ0.497-0.589=-0.092
min0.266-0.273=-0.007
max1.265-1.455=-0.190
policies=20
mean1739.994-1740.001=-0.007
σ0.331-0.322=0.009
min1739.761-1739.768=-0.007
max1740.481-1740.472=0.009
mean760.000
σ0.000
min760.000
max760.000
mean446.500-447.000=-0.500
σ9.950-9.381=0.569
min436.000-437.000=-1.000
max455.000
mean2.663-2.660=0.003
σ0.010-0.012=-0.002
min2.651-2.645=0.006
max2.671-2.671=0.000
policies=200
mean17409.347-17409.188=0.158
σ0.033-0.054=-0.021
min17409.314-17409.132=0.182
max17409.389-17409.259=0.130
mean7600.000
σ0.000
min7600.000
max7600.000
mean489.750-491.250=-1.500
σ2.500-2.754=-0.254
min487.000-488.000=-1.000
max493.000-494.000=-1.000
mean26.898-26.786=0.112
σ0.120-0.109=0.011
min26.794-26.665=0.130
max27.027-26.918=0.109