Compare commits

Home / Compare 7fde036b .. ed7bf3c7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.006-54.006=-0.000
σ0.368-0.366=0.002
min53.877-53.880=-0.003
max55.053-55.047=0.006
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.140-0.141=-0.000
σ0.003-0.004=-0.000
min0.138-0.137=0.001
max0.147-0.147=0.000
cache=y
dps=1
iters=10
policies=100
mean43.215-43.214=0.002
σ0.014-0.006=0.007
min43.203-43.201=0.001
max43.249-43.223=0.026
mean418.000
σ0.000
min418.000
max418.000
mean0.117-0.123=-0.005
σ0.004-0.003=0.001
min0.110-0.120=-0.010
max0.125-0.129=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.368-992.367=0.001
σ1.254-1.255=-0.002
min991.782-991.780=0.002
max997.639-997.645=-0.006
mean1074.250-1085.300=-11.050
σ317.368-334.244=-16.876
min592.000-608.000=-16.000
max1632.000-1650.000=-18.000
mean1.515-1.555=-0.040
σ0.082-0.135=-0.054
min1.397-1.461=-0.064
max1.795-2.017=-0.223

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean287.359-287.357=0.003
σ0.012-0.009=0.004
min287.340-287.343=-0.003
max287.370-287.367=0.003
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.377-0.371=0.006
σ0.003-0.007=-0.004
min0.374-0.367=0.007
max0.383-0.384=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1287.276-1287.323=-0.047
σ0.026-0.134=-0.108
min1287.262-1287.257=0.005
max1287.321-1287.562=-0.241
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean1.889-1.835=0.053
σ0.102-0.046=0.056
min1.808-1.801=0.008
max2.017-1.912=0.106
iters=5
new-facts=6402
prior-facts=1
mean1809.671-1809.649=0.022
σ7.007-7.098=-0.091
min1806.283-1806.253=0.030
max1822.190-1822.331=-0.141
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean4.245-4.166=0.079
σ0.301-0.545=-0.244
min3.853-3.804=0.050
max4.649-5.127=-0.478
iters=5
new-facts=6402
prior-facts=6402
mean2072.159-2072.155=0.004
σ0.007-0.009=-0.002
min2072.152-2072.145=0.007
max2072.169-2072.167=0.003
mean1842.200-1857.200=-15.000
σ195.001-201.309=-6.308
min1632.000-1650.000=-18.000
max2085.000-2082.000=3.000
mean4.940-4.956=-0.015
σ0.099-0.112=-0.013
min4.795-4.883=-0.088
max5.063-5.155=-0.092

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.258-1.343=-0.085
σ0.346-0.409=-0.063
min0.909-0.901=0.007
max1.737-1.746=-0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.414-437.412=0.002
σ572.400-572.408=-0.008
min151.203-151.205=-0.001
max1296.015-1296.024=-0.010
mean90.250
σ8.500
min86.000
max103.000
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.511-0.530=-0.019
σ0.510-0.537=-0.027
min0.255-0.260=-0.005
max1.277-1.336=-0.059
policies=20
mean1512.309-1512.310=-0.001
σ0.241-0.263=-0.022
min1512.160-1512.142=0.018
max1512.669-1512.702=-0.033
mean860.000
σ0.000
min860.000
max860.000
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean2.528-2.549=-0.021
σ0.006-0.056=-0.050
min2.521-2.511=0.010
max2.535-2.630=-0.095
policies=200
mean15130.790-15130.845=-0.055
σ0.112-0.070=0.042
min15130.669-15130.796=-0.127
max15130.896-15130.948=-0.051
mean8600.000
σ0.000
min8600.000
max8600.000
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean25.583-25.552=0.031
σ0.117-0.155=-0.039
min25.478-25.343=0.135
max25.741-25.677=0.064