Compare commits

Home / Compare b760cdc3 .. ae578463

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.971-53.822=0.150
σ0.369-0.369=0.000
min53.830-53.680=0.150
max55.023-54.872=0.151
mean415.000-418.700=-3.700
σ0.000-0.483=-0.483
min415.000-418.000=-3.000
max415.000-419.000=-4.000
mean0.140-0.138=0.003
σ0.004-0.004=0.001
min0.135-0.133=0.002
max0.147-0.144=0.003
cache=y
dps=1
iters=10
policies=100
mean43.343-43.208=0.135
σ0.006-0.007=-0.000
min43.336-43.198=0.139
max43.354-43.218=0.136
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.122-0.122=0.001
σ0.002-0.003=-0.001
min0.121-0.118=0.002
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.896-1016.176=0.720
σ1.147-1.175=-0.028
min1016.319-1015.603=0.716
max1021.688-1021.094=0.594
mean1064.600-1051.900=12.700
σ318.514-312.505=6.009
min604.000-559.000=45.000
max1636.000-1519.000=117.000
mean1.528-1.546=-0.019
σ0.086-0.056=0.030
min1.398-1.492=-0.095
max1.815-1.664=0.151

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.920-301.251=0.669
σ0.194-0.208=-0.014
min301.798-301.063=0.734
max302.455-301.780=0.674
mean2029.000-2021.000=8.000
σ0.000
min2029.000-2021.000=8.000
max2029.000-2021.000=8.000
mean0.596-0.565=0.031
σ0.007-0.032=-0.026
min0.581-0.511=0.070
max0.603-0.602=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.518-300.685=2.833
σ0.051-0.041=0.010
min303.444-300.615=2.829
max303.573-300.714=2.859
mean1636.000-1519.000=117.000
σ0.000
min1636.000-1519.000=117.000
max1636.000-1519.000=117.000
mean0.389-0.397=-0.008
σ0.001-0.007=-0.006
min0.387-0.388=-0.001
max0.391-0.405=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1326.064-1322.879=3.185
σ0.109-0.096=0.013
min1325.925-1322.815=3.110
max1326.178-1323.039=3.138
mean1636.000-1519.000=117.000
σ0.000
min1636.000-1519.000=117.000
max1636.000-1519.000=117.000
mean1.886-1.932=-0.046
σ0.060-0.117=-0.057
min1.830-1.820=0.010
max1.977-2.098=-0.120
iters=5
new-facts=6402
prior-facts=1
mean1564.159-1561.342=2.817
σ6.891-6.841=0.050
min1560.851-1558.047=2.804
max1576.481-1573.573=2.907
mean1636.000-1519.000=117.000
σ0.000
min1636.000-1519.000=117.000
max1636.000-1519.000=117.000
mean2.492-2.354=0.138
σ0.370-0.236=0.134
min2.065-1.984=0.081
max2.918-2.592=0.326
iters=5
new-facts=6402
prior-facts=6402
mean1894.003-1890.786=3.216
σ0.062-0.017=0.045
min1893.894-1890.767=3.127
max1894.045-1890.813=3.232
mean1772.400-1730.000=42.400
σ169.030-208.401=-39.371
min1636.000-1519.000=117.000
max2029.000-2021.000=8.000
mean2.931-2.902=0.028
σ0.117-0.048=0.069
min2.849-2.865=-0.017
max3.138-2.985=0.152

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.137-1.534=-0.398
σ0.252-0.256=-0.004
min0.909-1.190=-0.280
max1.558-1.779=-0.221

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.701-443.037=1.664
σ575.141-573.403=1.739
min157.125-156.331=0.794
max1307.412-1303.141=4.272
mean96.250
σ8.500
min92.000
max109.000
mean1636.000-1519.000=117.000
σ0.000
min1636.000-1519.000=117.000
max1636.000-1519.000=117.000
mean0.538-0.542=-0.004
σ0.551-0.555=-0.004
min0.261-0.258=0.003
max1.364-1.374=-0.010
policies=20
mean1571.547-1563.610=7.937
σ0.337-0.350=-0.013
min1571.366-1563.385=7.981
max1572.052-1564.132=7.921
mean920.000
σ0.000
min920.000
max920.000
mean1636.000-1519.000=117.000
σ0.000
min1636.000-1519.000=117.000
max1636.000-1519.000=117.000
mean2.636-2.633=0.003
σ0.044-0.072=-0.027
min2.592-2.584=0.008
max2.697-2.738=-0.041
policies=200
mean15723.322-15644.108=79.214
σ0.131-0.142=-0.011
min15723.198-15643.985=79.213
max15723.474-15644.264=79.211
mean9200.000
σ0.000
min9200.000
max9200.000
mean1636.000-1519.000=117.000
σ0.000
min1636.000-1519.000=117.000
max1636.000-1519.000=117.000
mean26.554-26.541=0.013
σ0.165-0.221=-0.056
min26.355-26.332=0.023
max26.758-26.783=-0.025