Compare commits

Home / Compare b9b8ed56 .. 60e948a4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.655-53.648=0.006
σ0.367-0.369=-0.002
min53.518-53.520=-0.003
max54.698-54.698=0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.136-0.140=-0.004
σ0.004-0.003=0.000
min0.132-0.136=-0.004
max0.142-0.145=-0.003
cache=y
dps=1
iters=10
policies=100
mean42.981-42.942=0.039
σ0.007-0.006=0.001
min42.972-42.933=0.038
max42.990-42.950=0.040
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.120-0.119=0.001
σ0.004-0.004=-0.000
min0.113-0.115=-0.002
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.970-991.861=22.109
σ1.176-1.215=-0.039
min1013.427-991.326=22.101
max1018.891-996.953=21.938
mean1047.400-1068.200=-20.800
σ319.074-324.608=-5.534
min585.000-602.000=-17.000
max1653.000-1639.000=14.000
mean1.634-1.536=0.098
σ0.067-0.106=-0.039
min1.561-1.370=0.192
max1.790-1.754=0.036

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.042
σ0.216
min298.838
max299.609
mean1957.000
σ0.000
min1957.000
max1957.000
mean0.570
σ0.019
min0.548
max0.595

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.676-285.440=9.236
σ0.019-0.010=0.009
min294.661-285.425=9.236
max294.707-285.448=9.259
mean1653.000-1639.000=14.000
σ0.000
min1653.000-1639.000=14.000
max1653.000-1639.000=14.000
mean0.386-0.383=0.002
σ0.011-0.009=0.002
min0.379-0.375=0.004
max0.406-0.396=0.010
iters=5
new-facts=1
prior-facts=6402
mean1316.937-1285.498=31.440
σ0.104-0.081=0.024
min1316.877-1285.357=31.520
max1317.123-1285.552=31.572
mean1653.000-1639.000=14.000
σ0.000
min1653.000-1639.000=14.000
max1653.000-1639.000=14.000
mean1.942-1.953=-0.010
σ0.060-0.140=-0.080
min1.849-1.827=0.022
max2.017-2.151=-0.134
iters=5
new-facts=6402
prior-facts=1
mean1555.287-1705.833=-150.546
σ6.864-6.868=-0.003
min1551.989-1702.618=-150.629
max1567.559-1718.112=-150.553
mean1653.000-1639.000=14.000
σ0.000
min1653.000-1639.000=14.000
max1653.000-1639.000=14.000
mean2.310-3.051=-0.741
σ0.205-0.326=-0.121
min2.070-2.671=-0.600
max2.561-3.383=-0.822
iters=5
new-facts=6402
prior-facts=6402
mean1884.780-1968.452=-83.672
σ0.040-0.020=0.020
min1884.753-1968.432=-83.679
max1884.852-1968.481=-83.629
mean1791.200-1900.200=-109.000
σ110.439-221.114=-110.675
min1653.000-1639.000=14.000
max1957.000-2176.000=-219.000
mean2.962-3.264=-0.302
σ0.168-0.127=0.041
min2.804-3.153=-0.349
max3.215-3.427=-0.212

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.190-1.339=-0.149
σ0.335-0.370=-0.035
min0.923-0.904=0.019
max1.755-1.773=-0.019

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.490-436.695=3.795
σ573.034-572.361=0.672
min153.967-150.509=3.459
max1300.041-1295.238=4.803
mean96.250-90.250=6.000
σ8.500
min92.000-86.000=6.000
max109.000-103.000=6.000
mean1653.000-1639.000=14.000
σ0.000
min1653.000-1639.000=14.000
max1653.000-1639.000=14.000
mean0.552-0.519=0.033
σ0.566-0.538=0.027
min0.268-0.249=0.019
max1.401-1.327=0.074
policies=20
mean1539.862-1505.344=34.518
σ0.312-0.245=0.067
min1539.673-1505.180=34.492
max1540.328-1505.709=34.619
mean920.000-860.000=60.000
σ0.000
min920.000-860.000=60.000
max920.000-860.000=60.000
mean1653.000-1639.000=14.000
σ0.000
min1653.000-1639.000=14.000
max1653.000-1639.000=14.000
mean2.593-2.523=0.071
σ0.017-0.015=0.001
min2.573-2.512=0.060
max2.613-2.545=0.068
policies=200
mean15406.574-15061.260=345.314
σ0.056-0.073=-0.018
min15406.514-15061.182=345.332
max15406.648-15061.358=345.291
mean9200.000-8600.000=600.000
σ0.000
min9200.000-8600.000=600.000
max9200.000-8600.000=600.000
mean1653.000-1639.000=14.000
σ0.000
min1653.000-1639.000=14.000
max1653.000-1639.000=14.000
mean26.299-25.488=0.811
σ0.156-0.114=0.042
min26.153-25.369=0.784
max26.496-25.618=0.878