Compare commits

Home / Compare 0cb98ed3 .. 085df39d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.001
σ0.370-0.370=0.001
min53.875-53.876=-0.000
max55.068-55.067=0.001
mean419.000-412.000=7.000
σ0.000
min419.000-412.000=7.000
max419.000-412.000=7.000
mean0.139-0.140=-0.001
σ0.004-0.004=-0.000
min0.136-0.136=-0.000
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.007-0.006=0.001
min43.310-43.314=-0.003
max43.337-43.336=0.002
mean419.000-412.000=7.000
σ0.000
min419.000-412.000=7.000
max419.000-412.000=7.000
mean0.123-0.123=0.000
σ0.003-0.003=-0.000
min0.120-0.119=0.001
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.307=0.002
σ1.164-1.173=-0.009
min1005.766-1005.753=0.013
max1011.182-1011.227=-0.045
mean1049.750-1050.150=-0.400
σ311.373-307.139=4.233
min600.000-584.000=16.000
max1638.000-1642.000=-4.000
mean1.553-1.529=0.024
σ0.092-0.076=0.016
min1.474-1.405=0.070
max1.814-1.779=0.035

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.179-296.144=0.035
σ0.306-0.233=0.072
min295.934-296.013=-0.079
max296.998-296.792=0.206
mean1949.000-1953.000=-4.000
σ0.000
min1949.000-1953.000=-4.000
max1949.000-1953.000=-4.000
mean0.548-0.551=-0.003
σ0.037-0.030=0.007
min0.504-0.515=-0.010
max0.593-0.584=0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.692-284.704=-0.011
σ0.033-0.031=0.002
min284.649-284.671=-0.022
max284.728-284.741=-0.013
mean1638.000-1642.000=-4.000
σ0.000
min1638.000-1642.000=-4.000
max1638.000-1642.000=-4.000
mean0.400-0.399=0.001
σ0.008-0.011=-0.003
min0.386-0.388=-0.001
max0.404-0.412=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.081-1295.053=0.028
σ0.123-0.078=0.045
min1294.967-1294.957=0.010
max1295.268-1295.155=0.113
mean1638.000-1642.000=-4.000
σ0.000
min1638.000-1642.000=-4.000
max1638.000-1642.000=-4.000
mean2.050-1.934=0.116
σ0.245-0.082=0.163
min1.792-1.814=-0.022
max2.390-2.010=0.380
iters=5
new-facts=6402
prior-facts=1
mean1539.224-1539.207=0.017
σ6.869-6.853=0.016
min1535.962-1535.900=0.062
max1551.508-1551.461=0.046
mean1638.000-1642.000=-4.000
σ0.000
min1638.000-1642.000=-4.000
max1638.000-1642.000=-4.000
mean2.292-2.228=0.064
σ0.254-0.151=0.102
min2.107-2.096=0.011
max2.714-2.479=0.235
iters=5
new-facts=6402
prior-facts=6402
mean1856.991-1856.988=0.002
σ0.058-0.055=0.002
min1856.921-1856.922=-0.002
max1857.056-1857.061=-0.005
mean1753.000-1765.200=-12.200
σ127.910-129.459=-1.549
min1638.000-1642.000=-4.000
max1949.000-1953.000=-4.000
mean2.927-2.948=-0.021
σ0.089-0.131=-0.042
min2.830-2.803=0.027
max3.054-3.147=-0.092

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.221-1.220=0.001
σ0.292-0.337=-0.045
min0.949-0.943=0.006
max1.692-1.767=-0.074

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.808-447.804=0.004
σ581.229-581.231=-0.001
min157.187-157.182=0.005
max1319.652-1319.650=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1642.000=-4.000
σ0.000
min1638.000-1642.000=-4.000
max1638.000-1642.000=-4.000
mean0.548-0.522=0.026
σ0.576-0.519=0.057
min0.259-0.262=-0.003
max1.412-1.301=0.111
policies=20
mean1572.134-1572.136=-0.002
σ0.352-0.341=0.011
min1571.935-1571.935=-0.001
max1572.662-1572.647=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1642.000=-4.000
σ0.000
min1638.000-1642.000=-4.000
max1638.000-1642.000=-4.000
mean2.661-2.641=0.021
σ0.069-0.009=0.060
min2.613-2.629=-0.016
max2.764-2.648=0.116
policies=200
mean15729.133-15728.983=0.149
σ0.135-0.139=-0.004
min15729.017-15728.852=0.164
max15729.326-15729.180=0.146
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1642.000=-4.000
σ0.000
min1638.000-1642.000=-4.000
max1638.000-1642.000=-4.000
mean26.711-26.755=-0.044
σ0.123-0.125=-0.003
min26.591-26.589=0.003
max26.830-26.870=-0.040