Compare commits

Home / Compare 4be8ed4e .. 3cc2db94

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.780=0.002
σ0.046-0.054=-0.008
min70.746-70.744=0.003
max70.909-70.931=-0.022
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.160-0.158=0.003
σ0.003-0.004=-0.000
min0.157-0.151=0.006
max0.166-0.162=0.004
cache=y
dps=1
iters=10
policies=100
mean21.492-21.494=-0.002
σ0.003-0.003=-0.000
min21.489-21.491=-0.002
max21.497-21.499=-0.002
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.065-0.065=-0.000
σ0.003-0.003=-0.000
min0.063-0.061=0.002
max0.073-0.073=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1751.880=2.214
σ0.359-0.361=-0.002
min1753.529-1751.311=2.218
max1754.675-1752.465=2.211
mean1656.350-1640.600=15.750
σ627.002-630.266=-3.264
min622.000-621.000=1.000
max2773.000-2786.000=-13.000
mean2.884-2.871=0.012
σ0.104-0.146=-0.042
min2.645-2.647=-0.002
max3.155-3.326=-0.171

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.594-269.379=2.214
σ0.008-0.006=0.002
min271.583-269.370=2.213
max271.602-269.387=2.215
mean2773.000-2786.000=-13.000
σ0.000
min2773.000-2786.000=-13.000
max2773.000-2786.000=-13.000
mean0.383-0.377=0.006
σ0.004-0.003=0.002
min0.378-0.375=0.004
max0.390-0.381=0.009
iters=5
new-facts=1
prior-facts=6402
mean1931.999-1929.744=2.255
σ0.007-0.017=-0.009
min1931.989-1929.716=2.273
max1932.009-1929.759=2.250
mean2773.000-2786.000=-13.000
σ0.000
min2773.000-2786.000=-13.000
max2773.000-2786.000=-13.000
mean2.538-3.108=-0.570
σ0.127-0.173=-0.047
min2.404-2.983=-0.579
max2.686-3.401=-0.715
iters=5
new-facts=6402
prior-facts=1
mean4752.591-4750.507=2.084
σ1.007-0.856=0.151
min4751.719-4750.057=1.662
max4754.333-4752.035=2.298
mean2773.000-2786.000=-13.000
σ0.000
min2773.000-2786.000=-13.000
max2773.000-2786.000=-13.000
mean8.696-8.431=0.265
σ0.440-0.442=-0.002
min7.994-7.695=0.299
max9.124-8.883=0.241
iters=5
new-facts=6402
prior-facts=6402
mean4943.136-4940.909=2.227
σ0.154-0.155=-0.001
min4942.862-4940.634=2.228
max4943.223-4940.998=2.225
mean3051.000-3037.200=13.800
σ268.127-317.482=-49.355
min2773.000-2786.000=-13.000
max3430.000-3525.000=-95.000
mean8.607-8.467=0.140
σ0.204-0.082=0.122
min8.418-8.400=0.018
max8.927-8.594=0.333

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.049-1.010=0.039
σ0.126-0.156=-0.030
min0.933-0.936=-0.003
max1.241-1.289=-0.048

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.631-462.710=5.921
σ574.927-574.967=-0.039
min181.167-175.224=5.944
max1331.022-1325.160=5.862
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2773.000-2786.000=-13.000
σ0.000
min2773.000-2786.000=-13.000
max2773.000-2786.000=-13.000
mean0.454-0.555=-0.100
σ0.307-0.555=-0.249
min0.298-0.276=0.022
max0.914-1.388=-0.473
policies=20
mean1811.965-1752.502=59.463
σ0.384-0.361=0.023
min1811.696-1752.279=59.417
max1812.526-1753.041=59.485
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2773.000-2786.000=-13.000
σ0.000
min2773.000-2786.000=-13.000
max2773.000-2786.000=-13.000
mean2.902-2.745=0.157
σ0.089-0.039=0.050
min2.816-2.707=0.109
max3.011-2.799=0.212
policies=200
mean18126.383-17532.028=594.355
σ0.407-0.613=-0.206
min18126.059-17531.403=594.656
max18126.978-17532.871=594.107
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2773.000-2786.000=-13.000
σ0.000
min2773.000-2786.000=-13.000
max2773.000-2786.000=-13.000
mean28.733-27.479=1.254
σ0.075-0.127=-0.053
min28.628-27.357=1.272
max28.805-27.658=1.148