Compare commits

Home / Compare 8e204fd3 .. b760cdc3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.822=-0.000
σ0.369-0.369=0.001
min53.680-53.679=0.001
max54.872-54.870=0.001
mean418.700-418.000=0.700
σ0.483-0.000=0.483
min418.000
max419.000-418.000=1.000
mean0.138-0.138=-0.001
σ0.004-0.005=-0.001
min0.133-0.128=0.005
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=-0.000
σ0.007-0.006=0.001
min43.198-43.200=-0.003
max43.218-43.216=0.002
mean419.000-418.000=1.000
σ0.000
min419.000-418.000=1.000
max419.000-418.000=1.000
mean0.122-0.118=0.003
σ0.003-0.004=-0.001
min0.118-0.114=0.005
max0.128-0.124=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.176-1016.175=0.001
σ1.175-1.179=-0.004
min1015.603-1015.612=-0.009
max1021.094-1021.118=-0.024
mean1051.900-1049.500=2.400
σ312.505-311.590=0.915
min559.000-557.000=2.000
max1519.000-1515.000=4.000
mean1.546-1.579=-0.033
σ0.056-0.138=-0.082
min1.492-1.493=-0.001
max1.664-2.111=-0.447

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.251-301.261=-0.009
σ0.208-0.198=0.010
min301.063-301.077=-0.013
max301.780-301.778=0.003
mean2021.000-2025.000=-4.000
σ0.000
min2021.000-2025.000=-4.000
max2021.000-2025.000=-4.000
mean0.565-0.538=0.027
σ0.032-0.032=0.001
min0.511-0.507=0.004
max0.602-0.574=0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.685-300.701=-0.016
σ0.041-0.031=0.010
min300.615-300.660=-0.045
max300.714-300.741=-0.027
mean1519.000-1515.000=4.000
σ0.000
min1519.000-1515.000=4.000
max1519.000-1515.000=4.000
mean0.397-0.398=-0.001
σ0.007-0.010=-0.002
min0.388-0.387=0.001
max0.405-0.412=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1322.879-1322.863=0.016
σ0.096-0.092=0.004
min1322.815-1322.812=0.003
max1323.039-1323.028=0.011
mean1519.000-1515.000=4.000
σ0.000
min1519.000-1515.000=4.000
max1519.000-1515.000=4.000
mean1.932-1.930=0.002
σ0.117-0.113=0.004
min1.820-1.801=0.019
max2.098-2.092=0.006
iters=5
new-facts=6402
prior-facts=1
mean1561.342-1561.301=0.040
σ6.841-6.891=-0.050
min1558.047-1558.003=0.044
max1573.573-1573.623=-0.050
mean1519.000-1515.000=4.000
σ0.000
min1519.000-1515.000=4.000
max1519.000-1515.000=4.000
mean2.354-2.307=0.047
σ0.236-0.326=-0.090
min1.984-1.997=-0.014
max2.592-2.671=-0.079
iters=5
new-facts=6402
prior-facts=6402
mean1890.786-1890.785=0.002
σ0.017-0.026=-0.009
min1890.767-1890.745=0.022
max1890.813-1890.817=-0.003
mean1730.000-1737.000=-7.000
σ208.401-214.064=-5.663
min1519.000-1515.000=4.000
max2021.000-2025.000=-4.000
mean2.902-2.867=0.035
σ0.048-0.123=-0.075
min2.865-2.738=0.128
max2.985-3.034=-0.049

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.534-1.467=0.067
σ0.256-0.274=-0.017
min1.190-1.193=-0.003
max1.779-1.786=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.037-443.039=-0.002
σ573.403-573.406=-0.003
min156.331-156.334=-0.003
max1303.141-1303.147=-0.007
mean96.250
σ8.500
min92.000
max109.000
mean1519.000-1515.000=4.000
σ0.000
min1519.000-1515.000=4.000
max1519.000-1515.000=4.000
mean0.542-0.544=-0.002
σ0.555-0.560=-0.005
min0.258-0.261=-0.003
max1.374-1.384=-0.010
policies=20
mean1563.610-1563.621=-0.011
σ0.350-0.343=0.007
min1563.385-1563.400=-0.016
max1564.132-1564.132=-0.001
mean920.000
σ0.000
min920.000
max920.000
mean1519.000-1515.000=4.000
σ0.000
min1519.000-1515.000=4.000
max1519.000-1515.000=4.000
mean2.633-2.621=0.012
σ0.072-0.011=0.061
min2.584-2.610=-0.025
max2.738-2.634=0.104
policies=200
mean15644.108-15644.159=-0.051
σ0.142-0.075=0.068
min15643.985-15644.056=-0.072
max15644.264-15644.231=0.033
mean9200.000
σ0.000
min9200.000
max9200.000
mean1519.000-1515.000=4.000
σ0.000
min1519.000-1515.000=4.000
max1519.000-1515.000=4.000
mean26.541-26.493=0.048
σ0.221-0.098=0.123
min26.332-26.417=-0.086
max26.783-26.633=0.150