Compare commits

Home / Compare b9ab416c .. 26cc8d24

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.773-70.685=0.088
σ0.053-0.042=0.010
min70.742-70.663=0.079
max70.920-70.804=0.116
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.159-0.155=0.003
σ0.003-0.004=-0.001
min0.156-0.150=0.006
max0.164-0.162=0.002
cache=y
dps=1
iters=10
policies=100
mean21.490-21.421=0.069
σ0.002-0.001=0.001
min21.487-21.419=0.067
max21.494-21.423=0.071
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.063-0.064=-0.001
σ0.004-0.003=0.001
min0.059-0.060=-0.001
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.285-1754.456=0.829
σ0.361-0.361=-0.000
min1754.720-1753.892=0.828
max1755.870-1755.045=0.825
mean1631.250-1658.450=-27.200
σ595.314-633.736=-38.422
min639.000-644.000=-5.000
max2426.000-2853.000=-427.000
mean2.816-2.778=0.038
σ0.179-0.203=-0.024
min2.344-2.324=0.021
max3.096-3.164=-0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.750-273.506=-0.755
σ0.014-0.005=0.009
min272.737-273.499=-0.763
max272.774-273.513=-0.739
mean2426.000-2853.000=-427.000
σ0.000
min2426.000-2853.000=-427.000
max2426.000-2853.000=-427.000
mean0.382-0.385=-0.003
σ0.004-0.004=0.000
min0.379-0.382=-0.003
max0.388-0.391=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1933.161-1933.902=-0.741
σ0.009-0.018=-0.009
min1933.150-1933.881=-0.731
max1933.174-1933.919=-0.745
mean2426.000-2853.000=-427.000
σ0.000
min2426.000-2853.000=-427.000
max2426.000-2853.000=-427.000
mean3.004-2.847=0.157
σ0.101-0.227=-0.126
min2.919-2.516=0.403
max3.177-3.064=0.113
iters=5
new-facts=6402
prior-facts=1
mean4753.919-4754.711=-0.793
σ0.825-0.807=0.018
min4753.394-4754.258=-0.864
max4755.382-4756.150=-0.768
mean2426.000-2853.000=-427.000
σ0.000
min2426.000-2853.000=-427.000
max2426.000-2853.000=-427.000
mean8.502-8.220=0.282
σ0.516-0.263=0.254
min7.750-7.934=-0.184
max9.178-8.536=0.642
iters=5
new-facts=6402
prior-facts=6402
mean4944.316-4945.048=-0.733
σ0.168-0.168=0.000
min4944.018-4944.749=-0.731
max4944.410-4945.137=-0.727
mean2968.200-3086.600=-118.400
σ264.308-308.905=-44.597
min2619.000-2853.000=-234.000
max3308.000-3562.000=-254.000
mean8.491-8.465=0.026
σ0.050-0.139=-0.088
min8.439-8.335=0.104
max8.562-8.679=-0.117

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.760-1.025=0.734
σ0.100-0.143=-0.042
min1.623-0.930=0.692
max1.884-1.259=0.624

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.833-472.571=0.262
σ574.922-574.929=-0.006
min185.367-185.104=0.263
max1335.216-1334.964=0.253
mean88.250
σ8.500
min84.000
max101.000
mean2426.000-2853.000=-427.000
σ0.000
min2426.000-2853.000=-427.000
max2426.000-2853.000=-427.000
mean0.551-0.471=0.080
σ0.526-0.347=0.178
min0.287-0.292=-0.004
max1.340-0.992=0.348
policies=20
mean1853.987-1851.296=2.691
σ0.374-0.380=-0.005
min1853.731-1851.009=2.721
max1854.540-1851.851=2.689
mean840.000
σ0.000
min840.000
max840.000
mean2426.000-2853.000=-427.000
σ0.000
min2426.000-2853.000=-427.000
max2426.000-2853.000=-427.000
mean2.871-2.951=-0.079
σ0.021-0.017=0.004
min2.854-2.934=-0.080
max2.898-2.968=-0.070
policies=200
mean18546.567-18519.406=27.161
σ0.556-0.527=0.028
min18546.212-18518.997=27.216
max18547.391-18520.151=27.241
mean8400.000
σ0.000
min8400.000
max8400.000
mean2426.000-2853.000=-427.000
σ0.000
min2426.000-2853.000=-427.000
max2426.000-2853.000=-427.000
mean28.804-29.291=-0.488
σ0.084-0.461=-0.377
min28.679-28.912=-0.233
max28.856-29.850=-0.994