Compare commits

Home / Compare a2717ca0 .. 27ca750e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.565=0.217
σ0.044-0.044=0.000
min70.749-70.538=0.211
max70.905-70.685=0.220
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.161-0.158=0.002
σ0.003-0.003=-0.000
min0.157-0.155=0.002
max0.165-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.493-21.288=0.205
σ0.002-0.003=-0.001
min21.489-21.284=0.205
max21.496-21.293=0.203
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.064-0.065=-0.000
σ0.003-0.002=0.002
min0.058-0.063=-0.006
max0.072-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1753.374=0.717
σ0.361-0.362=-0.001
min1753.531-1752.800=0.730
max1754.682-1753.960=0.722
mean1669.200-1640.100=29.100
σ637.477-597.131=40.346
min686.000-634.000=52.000
max2730.000-2436.000=294.000
mean2.824-2.777=0.047
σ0.154-0.215=-0.061
min2.540-2.207=0.333
max3.053-2.985=0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.600-271.755=-0.156
σ0.008-0.006=0.002
min271.594-271.750=-0.156
max271.609-271.765=-0.156
mean2730.000-2436.000=294.000
σ0.000
min2730.000-2436.000=294.000
max2730.000-2436.000=294.000
mean0.386-0.383=0.003
σ0.008-0.007=0.001
min0.379-0.376=0.003
max0.395-0.393=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.004-1932.181=-0.178
σ0.012-0.007=0.005
min1931.985-1932.173=-0.189
max1932.014-1932.192=-0.178
mean2730.000-2436.000=294.000
σ0.000
min2730.000-2436.000=294.000
max2730.000-2436.000=294.000
mean2.506-3.076=-0.570
σ0.085-0.186=-0.101
min2.404-2.885=-0.481
max2.609-3.341=-0.732
iters=5
new-facts=6402
prior-facts=1
mean4752.735-4752.911=-0.176
σ0.877-0.852=0.025
min4752.203-4752.449=-0.246
max4754.296-4754.426=-0.130
mean2730.000-2436.000=294.000
σ0.000
min2730.000-2436.000=294.000
max2730.000-2436.000=294.000
mean8.596-8.387=0.209
σ0.394-0.498=-0.104
min8.235-7.605=0.630
max9.216-8.806=0.410
iters=5
new-facts=6402
prior-facts=6402
mean4943.150-4943.378=-0.228
σ0.144-0.012=0.132
min4942.893-4943.361=-0.469
max4943.226-4943.391=-0.165
mean3039.400-3018.600=20.800
σ226.911-302.662=-75.751
min2730.000-2607.000=123.000
max3331.000-3404.000=-73.000
mean8.542-8.564=-0.021
σ0.126-0.070=0.056
min8.385-8.493=-0.107
max8.676-8.667=0.009

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.117-1.715=-0.598
σ0.229-0.159=0.070
min0.936-1.439=-0.503
max1.479-1.848=-0.369

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.640-467.854=0.786
σ574.941-575.924=-0.984
min181.168-179.887=1.281
max1331.051-1331.740=-0.689
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2730.000-2436.000=294.000
σ0.000
min2730.000-2436.000=294.000
max2730.000-2436.000=294.000
mean0.565-0.552=0.013
σ0.541-0.538=0.003
min0.287-0.280=0.006
max1.376-1.360=0.017
policies=20
mean1811.970-1799.148=12.822
σ0.385-0.379=0.006
min1811.706-1798.910=12.796
max1812.539-1799.713=12.826
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2730.000-2436.000=294.000
σ0.000
min2730.000-2436.000=294.000
max2730.000-2436.000=294.000
mean2.841-2.780=0.060
σ0.008-0.012=-0.004
min2.831-2.764=0.067
max2.851-2.793=0.059
policies=200
mean18126.636-17998.552=128.084
σ0.602-0.480=0.122
min18126.241-17998.267=127.974
max18127.517-17999.270=128.247
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2730.000-2436.000=294.000
σ0.000
min2730.000-2436.000=294.000
max2730.000-2436.000=294.000
mean28.742-28.115=0.627
σ0.050-0.074=-0.024
min28.699-28.024=0.675
max28.793-28.200=0.592