Compare commits

Home / Compare 5724ccb9 .. fce493fd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.821-53.822=-0.000
σ0.368-0.369=-0.001
min53.674-53.681=-0.007
max54.868-54.870=-0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.136-0.139=-0.003
σ0.005-0.004=0.001
min0.129-0.135=-0.006
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.209-43.209=-0.000
σ0.007-0.007=-0.000
min43.200-43.196=0.003
max43.217-43.217=-0.000
mean415.000
σ0.000
min415.000
max415.000
mean0.119-0.120=-0.001
σ0.005-0.002=0.002
min0.115-0.118=-0.003
max0.130-0.126=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.174-1016.178=-0.004
σ1.175-1.161=0.014
min1015.621-1015.603=0.018
max1021.091-1021.037=0.055
mean1047.700-1044.850=2.850
σ312.165-297.405=14.761
min555.000-587.000=-32.000
max1514.000-1460.000=54.000
mean1.558-1.567=-0.009
σ0.046-0.065=-0.019
min1.507-1.473=0.034
max1.671-1.734=-0.063

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.255-301.182=0.072
σ0.252-0.183=0.069
min300.990-301.045=-0.055
max301.910-301.669=0.241
mean2029.000-1957.000=72.000
σ0.000
min2029.000-1957.000=72.000
max2029.000-1957.000=72.000
mean0.584-0.568=0.016
σ0.033-0.016=0.017
min0.511-0.525=-0.014
max0.610-0.579=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.685-300.695=-0.010
σ0.046-0.036=0.010
min300.604-300.636=-0.031
max300.716-300.728=-0.012
mean1514.000-1460.000=54.000
σ0.000
min1514.000-1460.000=54.000
max1514.000-1460.000=54.000
mean0.399-0.401=-0.002
σ0.005-0.009=-0.004
min0.393-0.392=0.001
max0.404-0.414=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1322.871-1322.861=0.010
σ0.098-0.104=-0.006
min1322.803-1322.800=0.003
max1323.040-1323.046=-0.006
mean1514.000-1460.000=54.000
σ0.000
min1514.000-1460.000=54.000
max1514.000-1460.000=54.000
mean1.951-1.969=-0.018
σ0.125-0.131=-0.005
min1.813-1.824=-0.011
max2.093-2.156=-0.063
iters=5
new-facts=6402
prior-facts=1
mean1561.308-1561.315=-0.008
σ6.904-6.911=-0.007
min1558.015-1557.986=0.030
max1573.653-1573.671=-0.018
mean1514.000-1460.000=54.000
σ0.000
min1514.000-1460.000=54.000
max1514.000-1460.000=54.000
mean2.321-2.367=-0.047
σ0.307-0.310=-0.002
min2.058-2.083=-0.025
max2.754-2.795=-0.041
iters=5
new-facts=6402
prior-facts=6402
mean1890.787-1890.798=-0.011
σ0.018-0.021=-0.003
min1890.766-1890.780=-0.013
max1890.817-1890.834=-0.017
mean1731.400-1765.200=-33.800
σ212.333-155.324=57.008
min1514.000-1531.000=-17.000
max2029.000-1957.000=72.000
mean2.940-2.991=-0.050
σ0.091-0.129=-0.038
min2.888-2.873=0.015
max3.103-3.186=-0.083

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.454-1.737=-0.283
σ0.182-0.083=0.099
min1.216-1.606=-0.390
max1.679-1.831=-0.152

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.039-443.030=0.009
σ573.404-573.394=0.010
min156.333-156.329=0.004
max1303.146-1303.121=0.024
mean96.250
σ8.500
min92.000
max109.000
mean1514.000-1460.000=54.000
σ0.000
min1514.000-1460.000=54.000
max1514.000-1460.000=54.000
mean0.534-0.547=-0.013
σ0.544-0.561=-0.017
min0.260-0.265=-0.004
max1.349-1.388=-0.039
policies=20
mean1563.620-1563.622=-0.002
σ0.335-0.351=-0.015
min1563.418-1563.396=0.022
max1564.122-1564.145=-0.023
mean920.000
σ0.000
min920.000
max920.000
mean1514.000-1460.000=54.000
σ0.000
min1514.000-1460.000=54.000
max1514.000-1460.000=54.000
mean2.623-2.629=-0.007
σ0.015-0.015=0.000
min2.609-2.611=-0.002
max2.645-2.645=-0.000
policies=200
mean15644.044-15644.167=-0.123
σ0.070-0.056=0.014
min15643.954-15644.116=-0.162
max15644.100-15644.220=-0.120
mean9200.000
σ0.000
min9200.000
max9200.000
mean1514.000-1460.000=54.000
σ0.000
min1514.000-1460.000=54.000
max1514.000-1460.000=54.000
mean26.484-26.572=-0.088
σ0.144-0.195=-0.051
min26.298-26.397=-0.099
max26.617-26.837=-0.219