Compare commits

Home / Compare 1302fbbc .. ab5b021b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.959-30.959=0.000
σ0.050-0.048=0.002
min30.923-30.919=0.004
max31.098-31.091=0.007
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.078-0.078=-0.000
σ0.003-0.003=-0.000
min0.076-0.075=0.000
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=-0.000
σ0.002-0.003=-0.001
min21.056-21.054=0.002
max21.063-21.064=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.063-0.061=0.003
σ0.003-0.003=-0.001
min0.061-0.058=0.004
max0.070-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.409-1751.408=0.001
σ0.362-0.362=-0.000
min1750.841-1750.840=0.001
max1751.993-1752.006=-0.013
mean1664.000-1637.950=26.050
σ623.833-620.598=3.235
min640.000-646.000=-6.000
max2513.000-2478.000=35.000
mean2.815-2.789=0.027
σ0.179-0.163=0.016
min2.232-2.513=-0.281
max3.155-3.207=-0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.404-273.403=0.001
σ0.008-0.010=-0.002
min273.396-273.393=0.003
max273.414-273.414=0.000
mean2513.000-2478.000=35.000
σ0.000
min2513.000-2478.000=35.000
max2513.000-2478.000=35.000
mean0.386-0.384=0.002
σ0.011-0.008=0.003
min0.377-0.376=0.000
max0.398-0.397=0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.841-1933.843=-0.002
σ0.017-0.009=0.008
min1933.829-1933.833=-0.004
max1933.869-1933.856=0.013
mean2513.000-2478.000=35.000
σ0.000
min2513.000-2478.000=35.000
max2513.000-2478.000=35.000
mean2.862-3.194=-0.332
σ0.229-0.216=0.013
min2.496-2.891=-0.395
max3.082-3.469=-0.387
iters=5
new-facts=6402
prior-facts=1
mean4754.360-4754.340=0.021
σ0.791-0.872=-0.082
min4753.879-4753.866=0.013
max4755.767-4755.896=-0.129
mean2513.000-2478.000=35.000
σ0.000
min2513.000-2478.000=35.000
max2513.000-2478.000=35.000
mean8.312-8.680=-0.368
σ0.594-0.514=0.079
min7.800-7.783=0.017
max9.265-9.077=0.189
iters=5
new-facts=6402
prior-facts=6402
mean4944.725-4944.663=0.063
σ0.127-0.193=-0.067
min4944.525-4944.394=0.131
max4944.878-4944.889=-0.011
mean2943.200-3028.600=-85.400
σ396.335-415.514=-19.179
min2513.000-2478.000=35.000
max3471.000-3558.000=-87.000
mean8.438-8.641=-0.203
σ0.127-0.079=0.048
min8.345-8.548=-0.203
max8.660-8.745=-0.085

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.720-1.737=-0.017
σ0.187-0.137=0.050
min1.410-1.496=-0.086
max1.855-1.839=0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.335-463.332=0.003
σ572.197-572.197=0.000
min177.234-177.231=0.003
max1321.631-1321.628=0.004
mean79.750
σ7.500
min76.000
max91.000
mean2513.000-2478.000=35.000
σ0.000
min2513.000-2478.000=35.000
max2513.000-2478.000=35.000
mean0.572-0.556=0.017
σ0.580-0.556=0.024
min0.277-0.274=0.003
max1.443-1.389=0.053
policies=20
mean1772.587-1772.552=0.034
σ0.336-0.314=0.022
min1772.365-1772.340=0.025
max1773.085-1773.018=0.067
mean760.000
σ0.000
min760.000
max760.000
mean2513.000-2478.000=35.000
σ0.000
min2513.000-2478.000=35.000
max2513.000-2478.000=35.000
mean2.748-2.723=0.025
σ0.009-0.011=-0.001
min2.736-2.708=0.028
max2.757-2.731=0.026
policies=200
mean17732.369-17732.322=0.047
σ0.520-0.566=-0.046
min17731.992-17732.001=-0.009
max17733.131-17733.168=-0.037
mean7600.000
σ0.000
min7600.000
max7600.000
mean2513.000-2478.000=35.000
σ0.000
min2513.000-2478.000=35.000
max2513.000-2478.000=35.000
mean27.638-27.607=0.032
σ0.139-0.119=0.020
min27.450-27.483=-0.033
max27.776-27.768=0.008