Compare commits

Home / Compare 34a84c69 .. d62f8a4d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.709-53.709=0.000
σ0.367-0.364=0.003
min53.569-53.578=-0.008
max54.753-54.744=0.009
mean414.000-417.800=-3.800
σ0.000-0.422=-0.422
min414.000-417.000=-3.000
max414.000-418.000=-4.000
mean0.138-0.138=0.000
σ0.005-0.004=0.001
min0.130-0.134=-0.004
max0.146-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean42.978-42.978=-0.001
σ0.005-0.005=0.000
min42.967-42.972=-0.006
max42.984-42.987=-0.003
mean414.100-418.000=-3.900
σ0.316-0.000=0.316
min414.000-418.000=-4.000
max415.000-418.000=-3.000
mean0.121-0.119=0.002
σ0.004-0.004=-0.001
min0.117-0.115=0.002
max0.128-0.126=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.227-995.222=0.005
σ1.170-1.183=-0.013
min994.657-994.684=-0.028
max1000.135-1000.182=-0.047
mean1056.800-1059.150=-2.350
σ312.284-311.957=0.328
min604.000-601.000=3.000
max1625.000-1602.000=23.000
mean1.478-1.478=-0.000
σ0.075-0.090=-0.014
min1.383-1.380=0.003
max1.640-1.690=-0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.301-297.317=-0.016
σ0.022-0.004=0.019
min297.278-297.313=-0.035
max297.334-297.323=0.012
mean1625.000-1602.000=23.000
σ0.000
min1625.000-1602.000=23.000
max1625.000-1602.000=23.000
mean0.391-0.388=0.004
σ0.007-0.001=0.006
min0.387-0.387=0.001
max0.405-0.389=0.015
iters=5
new-facts=1
prior-facts=6402
mean1299.003-1299.023=-0.021
σ0.093-0.073=0.020
min1298.841-1298.896=-0.055
max1299.072-1299.079=-0.007
mean1625.000-1602.000=23.000
σ0.000
min1625.000-1602.000=23.000
max1625.000-1602.000=23.000
mean1.927-2.015=-0.088
σ0.057-0.153=-0.096
min1.853-1.865=-0.012
max2.009-2.172=-0.163
iters=5
new-facts=6402
prior-facts=1
mean1719.180-1719.186=-0.006
σ6.963-6.886=0.077
min1715.959-1716.004=-0.045
max1731.634-1731.501=0.132
mean1625.000-1602.000=23.000
σ0.000
min1625.000-1602.000=23.000
max1625.000-1602.000=23.000
mean3.109-2.964=0.145
σ0.547-0.215=0.332
min2.636-2.775=-0.138
max4.046-3.299=0.748
iters=5
new-facts=6402
prior-facts=6402
mean1981.955-1981.935=0.020
σ0.009-0.043=-0.034
min1981.949-1981.866=0.083
max1981.970-1981.984=-0.014
mean1827.200-1820.000=7.200
σ211.772-220.330=-8.559
min1625.000-1602.000=23.000
max2103.000-2131.000=-28.000
mean3.178-3.329=-0.151
σ0.057-0.417=-0.359
min3.104-3.051=0.053
max3.262-4.062=-0.799

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.218-1.300=-0.082
σ0.354-0.332=0.022
min0.901-0.993=-0.091
max1.763-1.766=-0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.465-440.464=0.001
σ573.037-573.039=-0.003
min153.939-153.936=0.003
max1300.020-1300.023=-0.003
mean94.250
σ8.500
min90.000
max107.000
mean1625.000-1602.000=23.000
σ0.000
min1625.000-1602.000=23.000
max1625.000-1602.000=23.000
mean0.558-0.546=0.011
σ0.603-0.581=0.023
min0.253-0.254=-0.001
max1.462-1.417=0.045
policies=20
mean1539.613-1539.612=0.000
σ0.302-0.306=-0.005
min1539.422-1539.412=0.010
max1540.062-1540.068=-0.006
mean900.000
σ0.000
min900.000
max900.000
mean1625.000-1602.000=23.000
σ0.000
min1625.000-1602.000=23.000
max1625.000-1602.000=23.000
mean2.564-2.572=-0.008
σ0.015-0.011=0.004
min2.550-2.558=-0.008
max2.581-2.582=-0.001
policies=200
mean15404.070-15403.947=0.123
σ0.067-0.041=0.026
min15403.993-15403.891=0.101
max15404.128-15403.983=0.145
mean9000.000
σ0.000
min9000.000
max9000.000
mean1625.000-1602.000=23.000
σ0.000
min1625.000-1602.000=23.000
max1625.000-1602.000=23.000
mean25.843-26.028=-0.184
σ0.125-0.166=-0.040
min25.732-25.828=-0.096
max26.008-26.228=-0.219