Compare commits

Home / Compare 8634ddeb .. 1061701b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.957-30.957=-0.000
σ0.048-0.051=-0.003
min30.920-30.914=0.005
max31.091-31.099=-0.008
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.078-0.078=-0.000
σ0.003-0.003=0.000
min0.075-0.075=-0.000
max0.082-0.083=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=-0.001
σ0.003-0.002=0.000
min21.056-21.055=0.001
max21.063-21.064=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.062-0.060=0.001
σ0.004-0.005=-0.001
min0.057-0.056=0.000
max0.070-0.070=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.411=0.000
σ0.364-0.362=0.002
min1750.840-1750.843=-0.003
max1751.996-1752.001=-0.005
mean1651.550-1651.600=-0.050
σ643.592-646.935=-3.344
min650.000-646.000=4.000
max2845.000-2847.000=-2.000
mean2.842-2.795=0.047
σ0.181-0.160=0.021
min2.414-2.344=0.070
max3.401-3.151=0.250

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.400-273.398=0.002
σ0.005-0.007=-0.001
min273.392-273.390=0.002
max273.406-273.408=-0.002
mean2845.000-2847.000=-2.000
σ0.000
min2845.000-2847.000=-2.000
max2845.000-2847.000=-2.000
mean0.390-0.385=0.005
σ0.007-0.011=-0.004
min0.377-0.376=0.001
max0.395-0.401=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.833-1933.830=0.003
σ0.011-0.012=-0.001
min1933.817-1933.811=0.007
max1933.845-1933.842=0.003
mean2845.000-2847.000=-2.000
σ0.000
min2845.000-2847.000=-2.000
max2845.000-2847.000=-2.000
mean3.012-3.136=-0.124
σ0.115-0.115=0.000
min2.899-3.000=-0.101
max3.153-3.306=-0.153
iters=5
new-facts=6402
prior-facts=1
mean4754.403-4754.347=0.057
σ0.854-0.801=0.053
min4753.892-4753.887=0.005
max4755.919-4755.773=0.146
mean2845.000-2847.000=-2.000
σ0.000
min2845.000-2847.000=-2.000
max2845.000-2847.000=-2.000
mean8.147-8.575=-0.428
σ0.601-0.300=0.301
min7.795-8.189=-0.394
max9.214-8.956=0.257
iters=5
new-facts=6402
prior-facts=6402
mean4944.793-4944.737=0.057
σ0.082-0.122=-0.040
min4944.730-4944.559=0.171
max4944.884-4944.902=-0.018
mean3060.800-3112.800=-52.000
σ293.889-255.826=38.063
min2845.000-2847.000=-2.000
max3522.000-3372.000=150.000
mean8.411-8.651=-0.240
σ0.092-0.204=-0.112
min8.308-8.440=-0.132
max8.554-8.954=-0.400

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.027-1.078=-0.051
σ0.137-0.254=-0.117
min0.935-0.933=0.001
max1.248-1.523=-0.275

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.341-463.346=-0.005
σ572.195-572.208=-0.013
min177.237-177.232=0.005
max1321.633-1321.657=-0.024
mean79.750
σ7.500
min76.000
max91.000
mean2845.000-2847.000=-2.000
σ0.000
min2845.000-2847.000=-2.000
max2845.000-2847.000=-2.000
mean0.438-0.438=0.000
σ0.299-0.302=-0.003
min0.286-0.283=0.003
max0.886-0.890=-0.004
policies=20
mean1772.624-1772.627=-0.002
σ0.339-0.336=0.004
min1772.378-1772.373=0.005
max1773.120-1773.117=0.003
mean760.000
σ0.000
min760.000
max760.000
mean2845.000-2847.000=-2.000
σ0.000
min2845.000-2847.000=-2.000
max2845.000-2847.000=-2.000
mean2.832-2.829=0.004
σ0.012-0.005=0.007
min2.816-2.825=-0.009
max2.841-2.835=0.005
policies=200
mean17732.564-17732.467=0.097
σ0.411-0.383=0.028
min17732.279-17732.121=0.158
max17733.174-17733.015=0.160
mean7600.000
σ0.000
min7600.000
max7600.000
mean2845.000-2847.000=-2.000
σ0.000
min2845.000-2847.000=-2.000
max2845.000-2847.000=-2.000
mean28.219-28.154=0.065
σ0.472-0.468=0.003
min27.734-27.617=0.117
max28.720-28.551=0.169