Compare commits

Home / Compare 27066610 .. 90a4bf20

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.779=0.004
σ0.044-0.045=-0.000
min70.757-70.752=0.006
max70.907-70.904=0.003
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.157-0.154=0.003
σ0.006-0.007=-0.002
min0.149-0.137=0.012
max0.164-0.162=0.002
cache=y
dps=1
iters=10
policies=100
mean21.494-21.494=-0.000
σ0.003-0.003=0.000
min21.489-21.490=-0.001
max21.498-21.497=0.000
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.065-0.066=-0.001
σ0.002-0.004=-0.001
min0.063-0.063=0.000
max0.071-0.074=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.093=0.001
σ0.360-0.360=0.000
min1753.521-1753.532=-0.011
max1754.678-1754.659=0.019
mean1656.600-1642.000=14.600
σ634.562-603.241=31.321
min626.000-638.000=-12.000
max2806.000-2456.000=350.000
mean2.832-2.826=0.006
σ0.168-0.183=-0.015
min2.535-2.279=0.256
max3.326-3.163=0.164

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.952-271.956=-0.003
σ0.007-0.005=0.001
min271.945-271.952=-0.007
max271.961-271.965=-0.004
mean2806.000-2456.000=350.000
σ0.000
min2806.000-2456.000=350.000
max2806.000-2456.000=350.000
mean0.374-0.384=-0.010
σ0.007-0.007=0.001
min0.361-0.377=-0.016
max0.378-0.395=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1932.317-1932.343=-0.025
σ0.010-0.014=-0.004
min1932.307-1932.324=-0.017
max1932.332-1932.358=-0.026
mean2806.000-2456.000=350.000
σ0.000
min2806.000-2456.000=350.000
max2806.000-2456.000=350.000
mean2.952-2.744=0.209
σ0.146-0.259=-0.113
min2.755-2.454=0.301
max3.146-3.039=0.107
iters=5
new-facts=6402
prior-facts=1
mean4753.062-4753.086=-0.024
σ0.866-0.916=-0.050
min4752.624-4752.565=0.059
max4754.609-4754.713=-0.104
mean2806.000-2456.000=350.000
σ0.000
min2806.000-2456.000=350.000
max2806.000-2456.000=350.000
mean8.667-8.642=0.026
σ0.211-0.423=-0.212
min8.434-7.974=0.460
max8.899-9.029=-0.130
iters=5
new-facts=6402
prior-facts=6402
mean4943.560-4943.418=0.142
σ0.015-0.199=-0.184
min4943.541-4943.189=0.352
max4943.574-4943.579=-0.005
mean3001.000-2914.200=86.800
σ208.732-390.301=-181.569
min2806.000-2456.000=350.000
max3309.000-3443.000=-134.000
mean8.516-8.383=0.133
σ0.208-0.068=0.140
min8.338-8.308=0.031
max8.868-8.468=0.400

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.124-1.783=-0.659
σ0.212-0.088=0.125
min0.924-1.668=-0.744
max1.419-1.899=-0.480

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.664-468.653=0.010
σ574.943-574.920=0.023
min181.189-181.190=-0.000
max1331.078-1331.033=0.045
mean88.250
σ8.500
min84.000
max101.000
mean2806.000-2456.000=350.000
σ0.000
min2806.000-2456.000=350.000
max2806.000-2456.000=350.000
mean0.475-0.566=-0.091
σ0.367-0.553=-0.186
min0.289-0.283=0.006
max1.026-1.396=-0.370
policies=20
mean1812.245-1812.192=0.052
σ0.371-0.384=-0.013
min1811.952-1811.933=0.019
max1812.772-1812.760=0.012
mean840.000
σ0.000
min840.000
max840.000
mean2806.000-2456.000=350.000
σ0.000
min2806.000-2456.000=350.000
max2806.000-2456.000=350.000
mean2.926-2.839=0.087
σ0.105-0.018=0.087
min2.815-2.813=0.002
max3.068-2.852=0.217
policies=200
mean18129.037-18129.025=0.012
σ0.399-0.542=-0.143
min18128.806-18128.550=0.256
max18129.634-18129.790=-0.156
mean8400.000
σ0.000
min8400.000
max8400.000
mean2806.000-2456.000=350.000
σ0.000
min2806.000-2456.000=350.000
max2806.000-2456.000=350.000
mean28.452-28.577=-0.125
σ0.052-0.132=-0.080
min28.387-28.435=-0.048
max28.515-28.696=-0.181