Compare commits

Home / Compare 79fd0ec4 .. 19a584bf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.781=0.001
σ0.048-0.047=0.002
min70.749-70.749=0.000
max70.915-70.910=0.005
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.158-0.159=-0.002
σ0.005-0.005=0.000
min0.151-0.153=-0.002
max0.166-0.169=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.000
σ0.001-0.002=-0.001
min21.491-21.490=0.001
max21.495-21.498=-0.003
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.063-0.067=-0.004
σ0.003-0.004=-0.000
min0.059-0.064=-0.005
max0.069-0.075=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.094=-0.002
σ0.360-0.361=-0.000
min1753.534-1753.529=0.005
max1754.663-1754.679=-0.016
mean1635.800-1658.600=-22.800
σ617.859-629.790=-11.930
min637.000-628.000=9.000
max2474.000-2771.000=-297.000
mean2.795-2.767=0.028
σ0.213-0.223=-0.009
min2.175-2.149=0.026
max3.282-3.025=0.257

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.598-271.601=-0.003
σ0.005-0.007=-0.002
min271.589-271.591=-0.002
max271.602-271.609=-0.006
mean2474.000-2771.000=-297.000
σ0.000
min2474.000-2771.000=-297.000
max2474.000-2771.000=-297.000
mean0.383-0.384=-0.001
σ0.004-0.007=-0.003
min0.380-0.379=0.001
max0.390-0.397=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1931.997-1932.003=-0.005
σ0.012-0.011=0.001
min1931.976-1931.990=-0.014
max1932.006-1932.013=-0.006
mean2474.000-2771.000=-297.000
σ0.000
min2474.000-2771.000=-297.000
max2474.000-2771.000=-297.000
mean2.522-2.579=-0.057
σ0.057-0.129=-0.072
min2.474-2.475=-0.001
max2.605-2.736=-0.131
iters=5
new-facts=6402
prior-facts=1
mean4752.814-4752.585=0.229
σ0.875-1.018=-0.143
min4752.247-4751.733=0.514
max4754.368-4754.354=0.014
mean2474.000-2771.000=-297.000
σ0.000
min2474.000-2771.000=-297.000
max2474.000-2771.000=-297.000
mean7.971-8.742=-0.772
σ0.529-0.483=0.046
min7.693-7.997=-0.305
max8.914-9.231=-0.317
iters=5
new-facts=6402
prior-facts=6402
mean4943.204-4943.212=-0.008
σ0.020-0.015=0.004
min4943.180-4943.195=-0.015
max4943.224-4943.230=-0.006
mean2925.800-3040.600=-114.800
σ392.309-248.281=144.028
min2474.000-2771.000=-297.000
max3421.000-3384.000=37.000
mean8.475-8.773=-0.297
σ0.112-0.218=-0.106
min8.378-8.472=-0.095
max8.667-9.023=-0.356

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.806-1.002=0.804
σ0.130-0.143=-0.013
min1.586-0.935=0.651
max1.896-1.258=0.637

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.627-468.642=-0.015
σ574.922-574.932=-0.010
min181.162-181.169=-0.007
max1331.010-1331.041=-0.031
mean88.250
σ8.500
min84.000
max101.000
mean2474.000-2771.000=-297.000
σ0.000
min2474.000-2771.000=-297.000
max2474.000-2771.000=-297.000
mean0.583-0.447=0.136
σ0.575-0.305=0.270
min0.287-0.291=-0.004
max1.446-0.904=0.542
policies=20
mean1811.939-1811.991=-0.052
σ0.395-0.389=0.005
min1811.663-1811.700=-0.037
max1812.519-1812.560=-0.042
mean840.000
σ0.000
min840.000
max840.000
mean2474.000-2771.000=-297.000
σ0.000
min2474.000-2771.000=-297.000
max2474.000-2771.000=-297.000
mean2.847-2.940=-0.093
σ0.022-0.093=-0.071
min2.821-2.849=-0.028
max2.875-3.067=-0.193
policies=200
mean18126.807-18126.758=0.049
σ0.480-0.543=-0.063
min18126.528-18126.342=0.186
max18127.526-18127.555=-0.030
mean8400.000
σ0.000
min8400.000
max8400.000
mean2474.000-2771.000=-297.000
σ0.000
min2474.000-2771.000=-297.000
max2474.000-2771.000=-297.000
mean28.677-28.681=-0.004
σ0.073-0.033=0.041
min28.607-28.648=-0.041
max28.780-28.722=0.057