Compare commits

Home / Compare c6d95afa .. 1122ba4f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-33.980=19.934
σ0.367-0.051=0.316
min53.786-33.944=19.842
max54.960-34.123=20.837
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.137-0.085=0.052
σ0.005-0.003=0.001
min0.132-0.082=0.051
max0.144-0.091=0.054
cache=y
dps=1
iters=10
policies=100
mean43.141-23.318=19.824
σ0.007-0.004=0.003
min43.131-23.313=19.818
max43.149-23.324=19.826
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.119-0.066=0.054
σ0.003-0.003=0.001
min0.114-0.064=0.050
max0.124-0.073=0.052

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.814-1757.303=-765.488
σ1.264-0.363=0.901
min991.238-1756.729=-765.491
max997.136-1757.890=-760.754
mean1063.550-1645.600=-582.050
σ321.474-625.138=-303.663
min569.000-633.000=-64.000
max1637.000-2823.000=-1186.000
mean1.538-2.377=-0.839
σ0.102-0.086=0.017
min1.456-2.253=-0.797
max1.847-2.633=-0.785

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-326.454=-41.042
σ0.011-0.045=-0.034
min285.396-326.374=-40.978
max285.422-326.481=-41.060
mean1637.000-2823.000=-1186.000
σ0.000
min1637.000-2823.000=-1186.000
max1637.000-2823.000=-1186.000
mean0.381-0.422=-0.041
σ0.007-0.001=0.006
min0.376-0.421=-0.045
max0.391-0.423=-0.032
iters=5
new-facts=1
prior-facts=6402
mean1285.376-1988.614=-703.238
σ0.138-0.010=0.128
min1285.308-1988.604=-703.296
max1285.623-1988.626=-703.004
mean1637.000-2823.000=-1186.000
σ0.000
min1637.000-2823.000=-1186.000
max1637.000-2823.000=-1186.000
mean1.857-2.688=-0.831
σ0.068-0.116=-0.048
min1.799-2.580=-0.782
max1.968-2.883=-0.915
iters=5
new-facts=6402
prior-facts=1
mean1807.682-4813.327=-3005.645
σ7.023-7.789=-0.766
min1804.316-4809.376=-3005.060
max1820.232-4827.251=-3007.019
mean1637.000-2823.000=-1186.000
σ0.000
min1637.000-2823.000=-1186.000
max1637.000-2823.000=-1186.000
mean4.099-8.749=-4.650
σ0.238-0.520=-0.282
min3.807-7.892=-4.085
max4.401-9.165=-4.765
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-5001.009=-2930.813
σ0.006-0.015=-0.009
min2070.190-5000.995=-2930.804
max2070.206-5001.030=-2930.824
mean1847.000-3004.600=-1157.600
σ174.581-203.003=-28.422
min1637.000-2823.000=-1186.000
max2090.000-3317.000=-1227.000
mean4.499-9.573=-5.074
σ0.096-0.543=-0.447
min4.433-8.612=-4.179
max4.666-9.934=-5.267

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.266-1.034=0.232
σ0.252-0.190=0.062
min1.038-0.919=0.119
max1.559-1.362=0.197

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.787-464.441=-27.654
σ572.358-574.774=-2.416
min150.601-177.044=-26.442
max1295.324-1326.603=-31.279
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1637.000-2823.000=-1186.000
σ0.000
min1637.000-2823.000=-1186.000
max1637.000-2823.000=-1186.000
mean0.551-0.437=0.114
σ0.601-0.308=0.292
min0.249-0.279=-0.030
max1.451-0.899=0.552
policies=20
mean1506.248-1770.799=-264.551
σ0.235-0.369=-0.134
min1506.093-1770.544=-264.451
max1506.597-1771.345=-264.748
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1637.000-2823.000=-1186.000
σ0.000
min1637.000-2823.000=-1186.000
max1637.000-2823.000=-1186.000
mean2.510-2.801=-0.291
σ0.013-0.040=-0.027
min2.493-2.768=-0.275
max2.525-2.860=-0.334
policies=200
mean15070.337-17715.022=-2644.685
σ0.111-0.439=-0.328
min15070.219-17714.754=-2644.535
max15070.447-17715.678=-2645.231
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1637.000-2823.000=-1186.000
σ0.000
min1637.000-2823.000=-1186.000
max1637.000-2823.000=-1186.000
mean25.663-27.823=-2.161
σ0.225-0.350=-0.124
min25.425-27.516=-2.091
max25.966-28.205=-2.240