Compare commits

Home / Compare 044afce2 .. b601c4bb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.821-53.821=0.000
σ0.367-0.367=0.001
min53.678-53.679=-0.001
max54.867-54.865=0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.138-0.138=-0.000
σ0.004-0.005=-0.001
min0.131-0.131=0.000
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.208-43.207=0.001
σ0.005-0.005=0.000
min43.200-43.203=-0.003
max43.219-43.221=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.122-0.120=0.002
σ0.003-0.005=-0.001
min0.119-0.112=0.007
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.178-1016.175=0.003
σ1.189-1.165=0.024
min1015.630-1015.636=-0.006
max1021.164-1021.050=0.115
mean1046.300-1040.600=5.700
σ312.768-311.307=1.461
min546.000-586.000=-40.000
max1660.000-1633.000=27.000
mean1.587-1.577=0.010
σ0.097-0.097=-0.000
min1.502-1.457=0.045
max1.857-1.840=0.018

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.310-301.437=-0.127
σ0.199-0.162=0.036
min301.155-301.276=-0.121
max301.840-301.811=0.030
mean2023.000-2024.000=-1.000
σ0.000
min2023.000-2024.000=-1.000
max2023.000-2024.000=-1.000
mean0.589-0.549=0.041
σ0.033-0.034=-0.001
min0.501-0.501=0.000
max0.610-0.579=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.689-300.687=0.002
σ0.036-0.039=-0.003
min300.632-300.620=0.012
max300.718-300.715=0.003
mean1660.000-1633.000=27.000
σ0.000
min1660.000-1633.000=27.000
max1660.000-1633.000=27.000
mean0.400-0.399=0.001
σ0.005-0.007=-0.002
min0.393-0.391=0.001
max0.407-0.405=0.001
iters=5
new-facts=1
prior-facts=6402
mean1322.863-1322.864=-0.001
σ0.094-0.089=0.005
min1322.816-1322.816=-0.000
max1323.031-1323.024=0.007
mean1660.000-1633.000=27.000
σ0.000
min1660.000-1633.000=27.000
max1660.000-1633.000=27.000
mean1.918-1.922=-0.004
σ0.093-0.114=-0.021
min1.822-1.822=0.001
max2.031-2.092=-0.061
iters=5
new-facts=6402
prior-facts=1
mean1561.315-1561.319=-0.004
σ6.900-6.901=-0.001
min1558.023-1558.025=-0.002
max1573.654-1573.660=-0.006
mean1660.000-1633.000=27.000
σ0.000
min1660.000-1633.000=27.000
max1660.000-1633.000=27.000
mean2.346-2.345=0.002
σ0.310-0.342=-0.032
min2.080-2.022=0.058
max2.764-2.761=0.004
iters=5
new-facts=6402
prior-facts=6402
mean1890.789-1890.787=0.002
σ0.013-0.021=-0.008
min1890.769-1890.759=0.010
max1890.802-1890.816=-0.014
mean1779.400-1769.200=10.200
σ156.035-167.108=-11.074
min1660.000-1633.000=27.000
max2023.000-2024.000=-1.000
mean2.939-2.950=-0.011
σ0.113-0.124=-0.011
min2.871-2.875=-0.004
max3.140-3.170=-0.030

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.043-1.186=-0.143
σ0.127-0.373=-0.246
min0.914-0.920=-0.007
max1.201-1.813=-0.612

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.045-443.044=0.001
σ573.406-573.416=-0.010
min156.334-156.331=0.003
max1303.154-1303.168=-0.014
mean96.250
σ8.500
min92.000
max109.000
mean1660.000-1633.000=27.000
σ0.000
min1660.000-1633.000=27.000
max1660.000-1633.000=27.000
mean0.534-0.539=-0.004
σ0.540-0.548=-0.008
min0.261-0.263=-0.002
max1.344-1.361=-0.017
policies=20
mean1563.626-1563.620=0.006
σ0.334-0.338=-0.004
min1563.438-1563.428=0.010
max1564.126-1564.127=-0.001
mean920.000
σ0.000
min920.000
max920.000
mean1660.000-1633.000=27.000
σ0.000
min1660.000-1633.000=27.000
max1660.000-1633.000=27.000
mean2.631-2.634=-0.003
σ0.013-0.014=-0.001
min2.623-2.615=0.008
max2.650-2.648=0.002
policies=200
mean15644.080-15644.108=-0.028
σ0.017-0.135=-0.118
min15644.062-15643.986=0.075
max15644.104-15644.259=-0.155
mean9200.000
σ0.000
min9200.000
max9200.000
mean1660.000-1633.000=27.000
σ0.000
min1660.000-1633.000=27.000
max1660.000-1633.000=27.000
mean26.821-26.672=0.149
σ0.204-0.186=0.019
min26.611-26.513=0.098
max27.088-26.924=0.164