Compare commits

Home / Compare 7f980753 .. be4b976e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.835-53.835=0.000
σ0.366-0.367=-0.001
min53.695-53.689=0.007
max54.877-54.879=-0.002
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.140-0.138=0.001
σ0.009-0.005=0.005
min0.130-0.132=-0.002
max0.157-0.146=0.010
cache=y
dps=1
iters=10
policies=100
mean43.208-43.209=-0.001
σ0.009-0.006=0.003
min43.199-43.200=-0.001
max43.225-43.220=0.005
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.123-0.121=0.003
σ0.009-0.003=0.006
min0.114-0.116=-0.002
max0.141-0.129=0.012

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.210-1016.208=0.003
σ1.153-1.165=-0.011
min1015.631-1015.630=0.002
max1021.029-1021.082=-0.052
mean1043.650-1047.450=-3.800
σ299.184-311.884=-12.700
min604.000-561.000=43.000
max1451.000-1513.000=-62.000
mean1.546-1.512=0.034
σ0.060-0.056=0.004
min1.494-1.448=0.047
max1.675-1.625=0.049

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.251-301.385=-0.133
σ0.220-0.234=-0.014
min301.091-301.259=-0.169
max301.858-302.041=-0.183
mean2024.000-2028.000=-4.000
σ0.000
min2024.000-2028.000=-4.000
max2024.000-2028.000=-4.000
mean0.552-0.560=-0.008
σ0.034-0.037=-0.003
min0.501-0.512=-0.011
max0.597-0.597=-0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.730-300.723=0.006
σ0.013-0.034=-0.020
min300.714-300.672=0.042
max300.749-300.761=-0.012
mean1451.000-1513.000=-62.000
σ0.000
min1451.000-1513.000=-62.000
max1451.000-1513.000=-62.000
mean0.397-0.401=-0.004
σ0.007-0.005=0.002
min0.389-0.392=-0.003
max0.406-0.404=0.002
iters=5
new-facts=1
prior-facts=6402
mean1322.894-1322.890=0.004
σ0.097-0.089=0.009
min1322.831-1322.836=-0.005
max1323.063-1323.044=0.019
mean1451.000-1513.000=-62.000
σ0.000
min1451.000-1513.000=-62.000
max1451.000-1513.000=-62.000
mean1.929-1.932=-0.003
σ0.120-0.120=-0.001
min1.812-1.835=-0.024
max2.087-2.067=0.020
iters=5
new-facts=6402
prior-facts=1
mean1561.323-1561.385=-0.062
σ6.904-6.834=0.070
min1557.977-1558.154=-0.177
max1573.668-1573.607=0.060
mean1451.000-1513.000=-62.000
σ0.000
min1451.000-1513.000=-62.000
max1451.000-1513.000=-62.000
mean2.337-2.402=-0.065
σ0.271-0.255=0.016
min2.120-2.037=0.082
max2.729-2.678=0.051
iters=5
new-facts=6402
prior-facts=6402
mean1890.811-1890.814=-0.003
σ0.016-0.019=-0.004
min1890.794-1890.787=0.007
max1890.835-1890.839=-0.004
mean1716.200-1736.600=-20.400
σ228.385-217.153=11.232
min1451.000-1513.000=-62.000
max2024.000-2028.000=-4.000
mean2.896-3.029=-0.133
σ0.124-0.328=-0.204
min2.778-2.855=-0.077
max3.108-3.615=-0.507

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.722-1.558=0.165
σ0.146-0.359=-0.212
min1.469-1.094=0.375
max1.842-1.847=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.476-443.478=-0.002
σ574.226-574.232=-0.006
min156.356-156.360=-0.004
max1304.815-1304.826=-0.011
mean96.250
σ8.500
min92.000
max109.000
mean1451.000-1513.000=-62.000
σ0.000
min1451.000-1513.000=-62.000
max1451.000-1513.000=-62.000
mean0.527-0.544=-0.018
σ0.529-0.561=-0.032
min0.259-0.261=-0.002
max1.320-1.385=-0.065
policies=20
mean1563.908-1563.886=0.021
σ0.351-0.333=0.019
min1563.682-1563.676=0.006
max1564.432-1564.383=0.049
mean920.000
σ0.000
min920.000
max920.000
mean1451.000-1513.000=-62.000
σ0.000
min1451.000-1513.000=-62.000
max1451.000-1513.000=-62.000
mean2.622-2.610=0.013
σ0.007-0.014=-0.007
min2.619-2.598=0.020
max2.633-2.630=0.004
policies=200
mean15646.926-15646.987=-0.061
σ0.161-0.144=0.017
min15646.806-15646.790=0.015
max15647.160-15647.095=0.064
mean9200.000
σ0.000
min9200.000
max9200.000
mean1451.000-1513.000=-62.000
σ0.000
min1451.000-1513.000=-62.000
max1451.000-1513.000=-62.000
mean26.455-26.528=-0.072
σ0.105-0.315=-0.210
min26.378-26.241=0.136
max26.608-26.953=-0.345