Compare commits

Home / Compare 78191e0e .. 56a02663

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.618=-0.002
σ0.055-0.055=-0.000
min35.584-35.589=-0.006
max35.771-35.773=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.084-0.086=-0.002
σ0.005-0.003=0.002
min0.077-0.083=-0.006
max0.091-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean24.047-24.048=-0.001
σ0.003-0.004=-0.001
min24.042-24.042=-0.000
max24.052-24.056=-0.004
mean414.000
σ0.000
min414.000
max414.000
mean0.066-0.070=-0.003
σ0.004-0.004=0.000
min0.061-0.066=-0.005
max0.074-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.491=-0.000
σ0.366-0.365=0.001
min1755.915-1755.916=-0.001
max1757.084-1757.079=0.005
mean1644.500-1646.450=-1.950
σ630.356-640.653=-10.297
min621.000-631.000=-10.000
max2835.000-2825.000=10.000
mean2.356-2.360=-0.005
σ0.070-0.069=0.001
min2.273-2.271=0.002
max2.495-2.490=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.767=-0.004
σ0.055-0.046=0.009
min324.664-324.685=-0.020
max324.794-324.796=-0.003
mean2835.000-2825.000=10.000
σ0.000
min2835.000-2825.000=10.000
max2835.000-2825.000=10.000
mean0.427-0.418=0.008
σ0.008-0.002=0.006
min0.421-0.416=0.005
max0.440-0.421=0.020
iters=5
new-facts=1
prior-facts=6402
mean1985.326-1985.309=0.016
σ0.006-0.022=-0.016
min1985.318-1985.282=0.036
max1985.334-1985.334=0.000
mean2835.000-2825.000=10.000
σ0.000
min2835.000-2825.000=10.000
max2835.000-2825.000=10.000
mean2.599-2.648=-0.050
σ0.066-0.136=-0.069
min2.523-2.549=-0.026
max2.673-2.879=-0.207
iters=5
new-facts=6402
prior-facts=1
mean4808.983-4809.090=-0.108
σ7.512-7.701=-0.189
min4805.557-4805.609=-0.052
max4822.421-4822.867=-0.446
mean2835.000-2825.000=10.000
σ0.000
min2835.000-2825.000=10.000
max2835.000-2825.000=10.000
mean9.061-8.765=0.296
σ0.424-0.585=-0.161
min8.663-7.746=0.918
max9.753-9.210=0.543
iters=5
new-facts=6402
prior-facts=6402
mean4996.558-4996.624=-0.066
σ0.167-0.017=0.150
min4996.262-4996.606=-0.345
max4996.653-4996.648=0.005
mean3050.800-3061.400=-10.600
σ198.606-307.123=-108.518
min2835.000-2825.000=10.000
max3339.000-3531.000=-192.000
mean8.605-8.680=-0.075
σ0.151-0.366=-0.215
min8.443-8.454=-0.011
max8.787-9.309=-0.522

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.942-0.947=-0.005
σ0.056-0.054=0.001
min0.911-0.910=0.001
max1.041-1.042=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.207-463.207=0.000
σ574.774-574.775=-0.001
min175.813-175.810=0.003
max1325.368-1325.369=-0.001
mean86.250
σ8.500
min82.000
max99.000
mean2835.000-2825.000=10.000
σ0.000
min2835.000-2825.000=10.000
max2835.000-2825.000=10.000
mean0.433-0.430=0.003
σ0.301-0.292=0.010
min0.282-0.282=-0.000
max0.885-0.868=0.017
policies=20
mean1758.538-1758.501=0.037
σ0.349-0.361=-0.011
min1758.294-1758.248=0.046
max1759.052-1759.033=0.018
mean820.000
σ0.000
min820.000
max820.000
mean2835.000-2825.000=10.000
σ0.000
min2835.000-2825.000=10.000
max2835.000-2825.000=10.000
mean2.804-2.809=-0.006
σ0.057-0.019=0.038
min2.770-2.795=-0.025
max2.889-2.835=0.053
policies=200
mean17592.065-17592.066=-0.001
σ0.560-0.521=0.039
min17591.622-17591.788=-0.166
max17592.885-17592.847=0.038
mean8200.000
σ0.000
min8200.000
max8200.000
mean2835.000-2825.000=10.000
σ0.000
min2835.000-2825.000=10.000
max2835.000-2825.000=10.000
mean27.894-27.874=0.020
σ0.278-0.539=-0.261
min27.593-27.347=0.247
max28.172-28.465=-0.293