Compare commits

Home / Compare 59b19c23 .. a9a9cffd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.823=-0.000
σ0.369-0.367=0.002
min53.682-53.678=0.004
max54.873-54.867=0.006
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.138-0.138=-0.001
σ0.005-0.004=0.001
min0.131-0.134=-0.004
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.209-43.208=0.001
σ0.007-0.007=0.000
min43.196-43.199=-0.003
max43.222-43.219=0.003
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.121-0.120=0.000
σ0.002-0.004=-0.002
min0.119-0.114=0.004
max0.125-0.126=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.180-1016.174=0.006
σ1.155-1.194=-0.039
min1015.602-1015.628=-0.026
max1021.009-1021.180=-0.171
mean1048.750-1042.300=6.450
σ304.472-303.959=0.514
min589.000-586.000=3.000
max1635.000-1654.000=-19.000
mean1.519-1.543=-0.023
σ0.097-0.100=-0.002
min1.349-1.459=-0.110
max1.759-1.817=-0.059

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.305-301.343=-0.038
σ0.208-0.216=-0.008
min301.198-301.116=0.082
max301.891-301.890=0.001
mean1918.000-1947.000=-29.000
σ0.000
min1918.000-1947.000=-29.000
max1918.000-1947.000=-29.000
mean0.589-0.552=0.038
σ0.020-0.038=-0.017
min0.557-0.500=0.057
max0.612-0.594=0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.699-300.704=-0.005
σ0.022-0.023=-0.001
min300.668-300.677=-0.008
max300.727-300.736=-0.009
mean1635.000-1654.000=-19.000
σ0.000
min1635.000-1654.000=-19.000
max1635.000-1654.000=-19.000
mean0.395-0.397=-0.002
σ0.007-0.009=-0.003
min0.389-0.390=-0.002
max0.403-0.412=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1322.852-1322.867=-0.014
σ0.105-0.104=0.002
min1322.780-1322.786=-0.006
max1323.039-1323.040=-0.001
mean1635.000-1654.000=-19.000
σ0.000
min1635.000-1654.000=-19.000
max1635.000-1654.000=-19.000
mean1.977-1.916=0.061
σ0.095-0.125=-0.030
min1.872-1.747=0.124
max2.123-2.045=0.078
iters=5
new-facts=6402
prior-facts=1
mean1561.366-1561.294=0.072
σ6.851-6.868=-0.017
min1558.101-1557.979=0.122
max1573.618-1573.575=0.043
mean1635.000-1654.000=-19.000
σ0.000
min1635.000-1654.000=-19.000
max1635.000-1654.000=-19.000
mean2.484-2.226=0.257
σ0.232-0.198=0.034
min2.143-2.058=0.085
max2.674-2.553=0.121
iters=5
new-facts=6402
prior-facts=6402
mean1890.796-1890.799=-0.003
σ0.036-0.019=0.016
min1890.774-1890.780=-0.006
max1890.860-1890.830=0.029
mean1768.400-1775.200=-6.800
σ142.654-108.080=34.575
min1635.000-1654.000=-19.000
max1918.000-1947.000=-29.000
mean3.190-2.999=0.191
σ0.424-0.137=0.287
min2.829-2.877=-0.048
max3.780-3.196=0.584

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.182-1.197=-0.016
σ0.365-0.424=-0.059
min0.904-0.909=-0.005
max1.789-1.926=-0.138

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.334-443.334=0.000
σ573.992-573.991=0.000
min156.333-156.338=-0.005
max1304.322-1304.321=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1635.000-1654.000=-19.000
σ0.000
min1635.000-1654.000=-19.000
max1635.000-1654.000=-19.000
mean0.559-0.531=0.028
σ0.592-0.537=0.055
min0.259-0.250=0.009
max1.446-1.336=0.110
policies=20
mean1563.637-1563.619=0.018
σ0.332-0.327=0.005
min1563.453-1563.438=0.016
max1564.134-1564.108=0.025
mean920.000
σ0.000
min920.000
max920.000
mean1635.000-1654.000=-19.000
σ0.000
min1635.000-1654.000=-19.000
max1635.000-1654.000=-19.000
mean2.620-2.622=-0.001
σ0.009-0.018=-0.008
min2.611-2.602=0.009
max2.630-2.643=-0.013
policies=200
mean15644.002-15644.051=-0.049
σ0.036-0.141=-0.106
min15643.967-15643.946=0.021
max15644.047-15644.249=-0.202
mean9200.000
σ0.000
min9200.000
max9200.000
mean1635.000-1654.000=-19.000
σ0.000
min1635.000-1654.000=-19.000
max1635.000-1654.000=-19.000
mean26.384-26.392=-0.008
σ0.082-0.136=-0.054
min26.292-26.244=0.048
max26.479-26.526=-0.048