Compare commits

Home / Compare d76a5002 .. cbd4ab3e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.655-53.711=-0.056
σ0.367-0.364=0.004
min53.518-53.578=-0.061
max54.700-54.745=-0.045
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.139-0.139=0.000
σ0.004-0.004=-0.000
min0.135-0.135=0.000
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean42.981-42.978=0.004
σ0.006-0.005=0.001
min42.973-42.966=0.006
max42.994-42.984=0.010
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.121-0.117=0.003
σ0.003-0.004=-0.001
min0.118-0.113=0.005
max0.127-0.125=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.968-995.226=18.742
σ1.179-1.168=0.012
min1013.421-994.692=18.729
max1018.904-1000.122=18.783
mean1051.300-1053.550=-2.250
σ314.960-313.156=1.804
min602.000-591.000=11.000
max1653.000-1513.000=140.000
mean1.607-1.485=0.122
σ0.066-0.148=-0.082
min1.491-1.376=0.114
max1.720-1.987=-0.267

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.145
σ0.224
min299.023
max299.770
mean2043.000
σ0.000
min2043.000
max2043.000
mean0.577
σ0.020
min0.540
max0.599

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.673-297.320=-2.647
σ0.014-0.007=0.007
min294.656-297.315=-2.658
max294.695-297.332=-2.637
mean1653.000-1513.000=140.000
σ0.000
min1653.000-1513.000=140.000
max1653.000-1513.000=140.000
mean0.380-0.386=-0.006
σ0.002-0.001=0.000
min0.378-0.384=-0.006
max0.382-0.388=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1316.931-1298.981=17.950
σ0.088-0.087=0.002
min1316.882-1298.844=18.039
max1317.089-1299.056=18.033
mean1653.000-1513.000=140.000
σ0.000
min1653.000-1513.000=140.000
max1653.000-1513.000=140.000
mean1.936-1.936=-0.001
σ0.087-0.034=0.053
min1.866-1.903=-0.037
max2.070-1.982=0.088
iters=5
new-facts=6402
prior-facts=1
mean1555.326-1719.181=-163.855
σ6.867-6.916=-0.049
min1552.051-1715.961=-163.910
max1567.606-1731.549=-163.944
mean1653.000-1513.000=140.000
σ0.000
min1653.000-1513.000=140.000
max1653.000-1513.000=140.000
mean2.417-3.100=-0.683
σ0.350-0.415=-0.065
min2.078-2.586=-0.508
max2.878-3.642=-0.764
iters=5
new-facts=6402
prior-facts=6402
mean1884.771-1981.910=-97.139
σ0.032-0.038=-0.005
min1884.742-1981.860=-97.119
max1884.826-1981.943=-97.117
mean1782.600-1777.800=4.800
σ163.899-203.909=-40.010
min1653.000-1513.000=140.000
max2043.000-2033.000=10.000
mean2.964-3.143=-0.178
σ0.106-0.079=0.027
min2.871-3.031=-0.160
max3.102-3.243=-0.141

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.145-1.584=-0.440
σ0.251-0.245=0.006
min0.904-1.304=-0.400
max1.531-1.824=-0.294

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.567-440.453=0.114
σ573.032-573.023=0.009
min154.045-153.934=0.111
max1300.115-1299.988=0.127
mean96.250-94.250=2.000
σ8.500
min92.000-90.000=2.000
max109.000-107.000=2.000
mean1653.000-1513.000=140.000
σ0.000
min1653.000-1513.000=140.000
max1653.000-1513.000=140.000
mean0.559-0.547=0.012
σ0.593-0.588=0.005
min0.260-0.248=0.012
max1.449-1.429=0.019
policies=20
mean1540.666-1539.594=1.072
σ0.304-0.305=-0.001
min1540.492-1539.391=1.101
max1541.121-1540.046=1.075
mean920.000-900.000=20.000
σ0.000
min920.000-900.000=20.000
max920.000-900.000=20.000
mean1653.000-1513.000=140.000
σ0.000
min1653.000-1513.000=140.000
max1653.000-1513.000=140.000
mean2.579-2.557=0.022
σ0.027-0.018=0.009
min2.541-2.532=0.009
max2.601-2.573=0.027
policies=200
mean15414.776-15404.034=10.742
σ0.159-0.104=0.055
min15414.638-15403.957=10.682
max15414.967-15404.188=10.780
mean9200.000-9000.000=200.000
σ0.000
min9200.000-9000.000=200.000
max9200.000-9000.000=200.000
mean1653.000-1513.000=140.000
σ0.000
min1653.000-1513.000=140.000
max1653.000-1513.000=140.000
mean26.266-25.969=0.297
σ0.173-0.219=-0.046
min26.097-25.811=0.286
max26.486-26.276=0.209