Compare commits

Home / Compare 8efb885e .. 5e5e70a0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.705=0.118
σ0.369-0.366=0.003
min53.676-53.572=0.104
max54.871-54.745=0.125
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.140-0.138=0.002
σ0.004-0.003=0.001
min0.136-0.135=0.001
max0.148-0.143=0.005
cache=y
dps=1
iters=10
policies=100
mean43.208-42.978=0.230
σ0.006-0.005=0.001
min43.198-42.967=0.232
max43.218-42.986=0.232
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.121-0.121=0.000
σ0.002-0.004=-0.001
min0.119-0.117=0.002
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.178-994.899=21.279
σ1.173-1.206=-0.033
min1015.636-994.366=21.271
max1021.089-999.956=21.132
mean1044.550-1065.650=-21.100
σ311.383-321.783=-10.399
min590.000-570.000=20.000
max1637.000-1627.000=10.000
mean1.585-1.464=0.121
σ0.098-0.082=0.015
min1.500-1.386=0.114
max1.866-1.647=0.218

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.316
σ0.236
min301.169
max301.969
mean1964.000
σ0.000
min1964.000
max1964.000
mean0.538
σ0.035
min0.508
max0.586

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.694-297.308=3.386
σ0.031-0.014=0.017
min300.646-297.291=3.355
max300.728-297.328=3.400
mean1637.000-1627.000=10.000
σ0.000
min1637.000-1627.000=10.000
max1637.000-1627.000=10.000
mean0.399-0.394=0.006
σ0.006-0.007=-0.001
min0.392-0.388=0.005
max0.405-0.403=0.001
iters=5
new-facts=1
prior-facts=6402
mean1322.872-1298.695=24.178
σ0.094-0.059=0.035
min1322.811-1298.598=24.213
max1323.033-1298.736=24.297
mean1637.000-1627.000=10.000
σ0.000
min1637.000-1627.000=10.000
max1637.000-1627.000=10.000
mean1.934-1.894=0.040
σ0.063-0.070=-0.007
min1.852-1.829=0.023
max2.004-1.988=0.015
iters=5
new-facts=6402
prior-facts=1
mean1561.307-1718.879=-157.572
σ6.877-6.897=-0.020
min1557.942-1715.690=-157.749
max1573.601-1731.213=-157.612
mean1637.000-1627.000=10.000
σ0.000
min1637.000-1627.000=10.000
max1637.000-1627.000=10.000
mean2.313-2.940=-0.627
σ0.283-0.311=-0.028
min2.049-2.524=-0.475
max2.623-3.377=-0.754
iters=5
new-facts=6402
prior-facts=6402
mean1890.803-1981.592=-90.789
σ0.031-0.036=-0.005
min1890.780-1981.528=-90.748
max1890.857-1981.612=-90.755
mean1793.200-1819.800=-26.600
σ121.370-202.763=-81.393
min1637.000-1627.000=10.000
max1964.000-2112.000=-148.000
mean3.031-3.297=-0.266
σ0.153-0.405=-0.252
min2.899-2.935=-0.036
max3.267-3.995=-0.727

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.136-1.266=-0.131
σ0.311-0.436=-0.126
min0.889-0.902=-0.013
max1.635-2.016=-0.382

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.042-440.377=2.664
σ573.416-572.876=0.540
min156.332-153.927=2.405
max1303.166-1299.692=3.474
mean96.250-94.250=2.000
σ8.500
min92.000-90.000=2.000
max109.000-107.000=2.000
mean1637.000-1627.000=10.000
σ0.000
min1637.000-1627.000=10.000
max1637.000-1627.000=10.000
mean0.546-0.561=-0.015
σ0.560-0.592=-0.033
min0.260-0.264=-0.004
max1.385-1.450=-0.064
policies=20
mean1563.605-1539.543=24.063
σ0.328-0.289=0.039
min1563.420-1539.353=24.067
max1564.097-1539.973=24.124
mean920.000-900.000=20.000
σ0.000
min920.000-900.000=20.000
max920.000-900.000=20.000
mean1637.000-1627.000=10.000
σ0.000
min1637.000-1627.000=10.000
max1637.000-1627.000=10.000
mean2.621-2.548=0.073
σ0.013-0.016=-0.003
min2.610-2.527=0.083
max2.640-2.563=0.076
policies=200
mean15643.942-15403.539=240.403
σ0.103-0.052=0.051
min15643.845-15403.499=240.347
max15644.079-15403.615=240.464
mean9200.000-9000.000=200.000
σ0.000
min9200.000-9000.000=200.000
max9200.000-9000.000=200.000
mean1637.000-1627.000=10.000
σ0.000
min1637.000-1627.000=10.000
max1637.000-1627.000=10.000
mean26.666-25.994=0.672
σ0.237-0.168=0.069
min26.444-25.852=0.592
max26.988-26.219=0.769