Compare commits

Home / Compare e97bc708 .. 694a6ab7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.821=0.002
σ0.369-0.366=0.003
min53.674-53.674=0.000
max54.871-54.861=0.010
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.139-0.135=0.005
σ0.003-0.005=-0.001
min0.135-0.129=0.006
max0.146-0.141=0.005
cache=y
dps=1
iters=10
policies=100
mean43.208-43.207=0.000
σ0.006-0.006=0.001
min43.197-43.201=-0.003
max43.216-43.215=0.001
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.121-0.121=-0.000
σ0.003-0.002=0.001
min0.118-0.119=-0.001
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.174-1016.179=-0.004
σ1.176-1.155=0.021
min1015.630-1015.611=0.019
max1021.105-1021.000=0.105
mean1051.850-1045.450=6.400
σ311.485-296.555=14.931
min585.000-587.000=-2.000
max1666.000-1463.000=203.000
mean1.561-1.560=0.001
σ0.084-0.072=0.012
min1.480-1.488=-0.007
max1.788-1.741=0.048

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.391-301.465=-0.074
σ0.222-0.228=-0.007
min301.176-301.326=-0.150
max301.978-302.097=-0.119
mean2020.000-1992.000=28.000
σ0.000
min2020.000-1992.000=28.000
max2020.000-1992.000=28.000
mean0.549-0.524=0.025
σ0.032-0.020=0.012
min0.510-0.500=0.010
max0.576-0.564=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.685-300.698=-0.013
σ0.048-0.024=0.024
min300.602-300.664=-0.061
max300.723-300.729=-0.006
mean1666.000-1463.000=203.000
σ0.000
min1666.000-1463.000=203.000
max1666.000-1463.000=203.000
mean0.395-0.396=-0.001
σ0.007-0.009=-0.002
min0.390-0.388=0.002
max0.404-0.407=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1322.861-1322.856=0.004
σ0.096-0.097=-0.001
min1322.808-1322.784=0.024
max1323.031-1323.026=0.004
mean1666.000-1463.000=203.000
σ0.000
min1666.000-1463.000=203.000
max1666.000-1463.000=203.000
mean1.956-1.867=0.089
σ0.117-0.061=0.056
min1.834-1.826=0.008
max2.099-1.975=0.124
iters=5
new-facts=6402
prior-facts=1
mean1561.340-1561.309=0.031
σ6.834-6.879=-0.045
min1558.075-1557.998=0.076
max1573.559-1573.608=-0.048
mean1666.000-1463.000=203.000
σ0.000
min1666.000-1463.000=203.000
max1666.000-1463.000=203.000
mean2.319-2.330=-0.011
σ0.177-0.234=-0.057
min2.087-2.115=-0.027
max2.477-2.695=-0.218
iters=5
new-facts=6402
prior-facts=6402
mean1890.797-1890.798=-0.000
σ0.013-0.031=-0.018
min1890.784-1890.778=0.007
max1890.815-1890.853=-0.038
mean1781.400-1739.200=42.200
σ152.462-169.764=-17.301
min1666.000-1545.000=121.000
max2020.000-1992.000=28.000
mean2.867-2.952=-0.085
σ0.085-0.087=-0.002
min2.721-2.825=-0.104
max2.943-3.029=-0.087

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.035-1.734=-0.699
σ0.139-0.035=0.104
min0.901-1.700=-0.799
max1.229-1.791=-0.562

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.341-443.320=0.020
σ573.987-573.972=0.015
min156.346-156.332=0.014
max1304.321-1304.279=0.042
mean96.250
σ8.500
min92.000
max109.000
mean1666.000-1463.000=203.000
σ0.000
min1666.000-1463.000=203.000
max1666.000-1463.000=203.000
mean0.559-0.535=0.023
σ0.594-0.548=0.046
min0.260-0.253=0.008
max1.449-1.357=0.092
policies=20
mean1563.628-1563.618=0.010
σ0.333-0.343=-0.010
min1563.447-1563.395=0.052
max1564.127-1564.129=-0.002
mean920.000
σ0.000
min920.000
max920.000
mean1666.000-1463.000=203.000
σ0.000
min1666.000-1463.000=203.000
max1666.000-1463.000=203.000
mean2.631-2.624=0.007
σ0.012-0.013=-0.000
min2.613-2.610=0.003
max2.640-2.638=0.002
policies=200
mean15644.106-15644.083=0.023
σ0.103-0.035=0.068
min15643.989-15644.048=-0.059
max15644.240-15644.123=0.117
mean9200.000
σ0.000
min9200.000
max9200.000
mean1666.000-1463.000=203.000
σ0.000
min1666.000-1463.000=203.000
max1666.000-1463.000=203.000
mean26.692-26.622=0.070
σ0.217-0.148=0.069
min26.379-26.461=-0.082
max26.869-26.816=0.052