Compare commits

Home / Compare 91ea2cbc .. c5393cde

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.652-53.915=-0.263
σ0.367-0.368=-0.001
min53.512-53.785=-0.273
max54.696-54.961=-0.265
mean414.000-415.600=-1.600
σ0.000-0.843=-0.843
min414.000
max414.000-416.000=-2.000
mean0.135-0.138=-0.004
σ0.004-0.005=-0.001
min0.131-0.131=0.000
max0.143-0.147=-0.004
cache=y
dps=1
iters=10
policies=100
mean42.980-43.140=-0.159
σ0.007-0.005=0.002
min42.970-43.134=-0.164
max42.992-43.148=-0.156
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.119-0.121=-0.002
σ0.005-0.004=0.001
min0.114-0.117=-0.003
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.971-992.081=21.890
σ1.172-1.228=-0.056
min1013.427-991.504=21.923
max1018.868-997.240=21.628
mean1048.900-1066.000=-17.100
σ316.324-314.088=2.236
min584.000-604.000=-20.000
max1653.000-1582.000=71.000
mean1.621-1.526=0.095
σ0.084-0.071=0.013
min1.481-1.435=0.046
max1.889-1.716=0.173

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.096
σ0.204
min298.946
max299.656
mean1959.000
σ0.000
min1959.000
max1959.000
mean0.578
σ0.024
min0.548
max0.619

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.678-285.675=9.003
σ0.011-0.015=-0.004
min294.664-285.650=9.014
max294.695-285.688=9.007
mean1653.000-1582.000=71.000
σ0.000
min1653.000-1582.000=71.000
max1653.000-1582.000=71.000
mean0.388-0.375=0.013
σ0.007-0.001=0.006
min0.380-0.374=0.005
max0.393-0.376=0.017
iters=5
new-facts=1
prior-facts=6402
mean1316.933-1285.646=31.287
σ0.091-0.141=-0.050
min1316.888-1285.580=31.308
max1317.095-1285.898=31.197
mean1653.000-1582.000=71.000
σ0.000
min1653.000-1582.000=71.000
max1653.000-1582.000=71.000
mean1.895-1.932=-0.037
σ0.056-0.116=-0.060
min1.856-1.810=0.047
max1.993-2.075=-0.082
iters=5
new-facts=6402
prior-facts=1
mean1555.299-1807.971=-252.672
σ6.893-7.016=-0.123
min1551.991-1804.609=-252.618
max1567.624-1820.506=-252.882
mean1653.000-1582.000=71.000
σ0.000
min1653.000-1582.000=71.000
max1653.000-1582.000=71.000
mean2.335-4.166=-1.831
σ0.327-0.169=0.158
min2.139-3.927=-1.788
max2.915-4.396=-1.481
iters=5
new-facts=6402
prior-facts=6402
mean1884.771-2070.464=-185.692
σ0.016-0.008=0.007
min1884.756-2070.456=-185.700
max1884.793-2070.478=-185.685
mean1741.600-1853.400=-111.800
σ135.236-213.837=-78.601
min1653.000-1582.000=71.000
max1959.000-2086.000=-127.000
mean2.910-4.566=-1.656
σ0.119-0.120=-0.001
min2.831-4.422=-1.592
max3.120-4.692=-1.572

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.180-1.314=-0.135
σ0.329-0.390=-0.061
min0.905-0.895=0.010
max1.731-1.739=-0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.569-437.385=3.185
σ573.035-572.365=0.670
min154.048-151.201=2.848
max1300.122-1295.932=4.190
mean96.250-90.250=6.000
σ8.500
min92.000-86.000=6.000
max109.000-103.000=6.000
mean1653.000-1582.000=71.000
σ0.000
min1653.000-1582.000=71.000
max1653.000-1582.000=71.000
mean0.541-0.534=0.007
σ0.547-0.559=-0.012
min0.268-0.251=0.017
max1.361-1.373=-0.011
policies=20
mean1540.690-1512.254=28.437
σ0.305-0.251=0.054
min1540.517-1512.088=28.429
max1541.148-1512.627=28.521
mean920.000-860.000=60.000
σ0.000
min920.000-860.000=60.000
max920.000-860.000=60.000
mean1653.000-1582.000=71.000
σ0.000
min1653.000-1582.000=71.000
max1653.000-1582.000=71.000
mean2.584-2.527=0.057
σ0.008-0.010=-0.002
min2.576-2.514=0.063
max2.595-2.536=0.058
policies=200
mean15414.837-15130.115=284.722
σ0.063-0.068=-0.005
min15414.800-15130.016=284.784
max15414.931-15130.166=284.765
mean9200.000-8600.000=600.000
σ0.000
min9200.000-8600.000=600.000
max9200.000-8600.000=600.000
mean1653.000-1582.000=71.000
σ0.000
min1653.000-1582.000=71.000
max1653.000-1582.000=71.000
mean26.111-25.608=0.502
σ0.120-0.104=0.016
min25.981-25.462=0.519
max26.255-25.692=0.563