Compare commits

Home / Compare 5c93d8f8 .. ba4382d8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.652-53.646=0.006
σ0.367-0.365=0.002
min53.512-53.511=0.001
max54.696-54.685=0.010
mean414.000-416.300=-2.300
σ0.000-0.483=-0.483
min414.000-416.000=-2.000
max414.000-417.000=-3.000
mean0.135-0.139=-0.004
σ0.004-0.003=0.002
min0.131-0.135=-0.004
max0.143-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.980-42.943=0.037
σ0.007-0.006=0.001
min42.970-42.932=0.037
max42.992-42.952=0.039
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.119-0.121=-0.002
σ0.005-0.003=0.001
min0.114-0.117=-0.003
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.971-991.803=22.167
σ1.172-1.237=-0.065
min1013.427-991.227=22.199
max1018.868-997.004=21.863
mean1048.900-1065.600=-16.700
σ316.324-319.464=-3.140
min584.000-617.000=-33.000
max1653.000-1644.000=9.000
mean1.621-1.544=0.077
σ0.084-0.102=-0.018
min1.481-1.453=0.028
max1.889-1.915=-0.026

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.096
σ0.204
min298.946
max299.656
mean1959.000
σ0.000
min1959.000
max1959.000
mean0.578
σ0.024
min0.548
max0.619

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.678-285.394=9.284
σ0.011-0.018=-0.007
min294.664-285.368=9.295
max294.695-285.412=9.283
mean1653.000-1644.000=9.000
σ0.000
min1653.000-1644.000=9.000
max1653.000-1644.000=9.000
mean0.388-0.379=0.009
σ0.007-0.006=0.001
min0.380-0.374=0.006
max0.393-0.390=0.003
iters=5
new-facts=1
prior-facts=6402
mean1316.933-1285.356=31.577
σ0.091-0.126=-0.035
min1316.888-1285.297=31.591
max1317.095-1285.580=31.515
mean1653.000-1644.000=9.000
σ0.000
min1653.000-1644.000=9.000
max1653.000-1644.000=9.000
mean1.895-1.917=-0.023
σ0.056-0.056=0.000
min1.856-1.877=-0.020
max1.993-2.015=-0.022
iters=5
new-facts=6402
prior-facts=1
mean1555.299-1807.688=-252.389
σ6.893-7.005=-0.112
min1551.991-1804.331=-252.340
max1567.624-1820.202=-252.578
mean1653.000-1644.000=9.000
σ0.000
min1653.000-1644.000=9.000
max1653.000-1644.000=9.000
mean2.335-4.189=-1.853
σ0.327-0.182=0.145
min2.139-3.893=-1.754
max2.915-4.369=-1.454
iters=5
new-facts=6402
prior-facts=6402
mean1884.771-2070.181=-185.410
σ0.016-0.009=0.006
min1884.756-2070.171=-185.415
max1884.793-2070.195=-185.403
mean1741.600-1854.800=-113.200
σ135.236-175.292=-40.056
min1653.000-1644.000=9.000
max1959.000-2099.000=-140.000
mean2.910-4.506=-1.596
σ0.119-0.036=0.083
min2.831-4.464=-1.634
max3.120-4.555=-1.435

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.180-1.170=0.010
σ0.329-0.302=0.027
min0.905-0.916=-0.011
max1.731-1.687=0.044

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.569-436.776=3.793
σ573.035-572.365=0.670
min154.048-150.591=3.457
max1300.122-1295.323=4.799
mean96.250-90.250=6.000
σ8.500
min92.000-86.000=6.000
max109.000-103.000=6.000
mean1653.000-1644.000=9.000
σ0.000
min1653.000-1644.000=9.000
max1653.000-1644.000=9.000
mean0.541-0.524=0.018
σ0.547-0.545=0.001
min0.268-0.248=0.019
max1.361-1.342=0.019
policies=20
mean1540.690-1506.200=34.490
σ0.305-0.235=0.071
min1540.517-1506.046=34.471
max1541.148-1506.550=34.598
mean920.000-860.000=60.000
σ0.000
min920.000-860.000=60.000
max920.000-860.000=60.000
mean1653.000-1644.000=9.000
σ0.000
min1653.000-1644.000=9.000
max1653.000-1644.000=9.000
mean2.584-2.517=0.067
σ0.008-0.012=-0.004
min2.576-2.501=0.076
max2.595-2.528=0.067
policies=200
mean15414.837-15069.633=345.205
σ0.063-0.480=-0.417
min15414.800-15068.917=345.883
max15414.931-15069.934=344.997
mean9200.000-8600.000=600.000
σ0.000
min9200.000-8600.000=600.000
max9200.000-8600.000=600.000
mean1653.000-1644.000=9.000
σ0.000
min1653.000-1644.000=9.000
max1653.000-1644.000=9.000
mean26.111-25.518=0.593
σ0.120-0.207=-0.087
min25.981-25.346=0.635
max26.255-25.787=0.468