Compare commits

Home / Compare d6dd8bc0 .. b92ce3a5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.823=-0.001
σ0.369-0.367=0.002
min53.676-53.683=-0.007
max54.873-54.869=0.005
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.137-0.145=-0.007
σ0.004-0.009=-0.005
min0.131-0.136=-0.005
max0.144-0.165=-0.021
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=-0.000
σ0.006-0.006=-0.000
min43.198-43.201=-0.003
max43.220-43.222=-0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.122-0.122=-0.000
σ0.005-0.004=0.001
min0.118-0.118=-0.001
max0.131-0.129=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.176-1016.177=-0.001
σ1.172-1.169=0.003
min1015.609-1015.605=0.003
max1021.087-1021.072=0.015
mean1046.150-1049.250=-3.100
σ292.599-314.081=-21.482
min580.000-552.000=28.000
max1431.000-1665.000=-234.000
mean1.537-1.541=-0.004
σ0.068-0.083=-0.015
min1.458-1.471=-0.013
max1.728-1.770=-0.042

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.450-301.292=0.159
σ0.243-0.198=0.045
min301.241-301.157=0.084
max302.117-301.840=0.277
mean1951.000-1953.000=-2.000
σ0.000
min1951.000-1953.000=-2.000
max1951.000-1953.000=-2.000
mean0.567-0.569=-0.002
σ0.035-0.032=0.003
min0.510-0.499=0.011
max0.609-0.596=0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.704-300.695=0.008
σ0.022-0.030=-0.007
min300.679-300.647=0.032
max300.736-300.724=0.012
mean1431.000-1665.000=-234.000
σ0.000
min1431.000-1665.000=-234.000
max1431.000-1665.000=-234.000
mean0.396-0.402=-0.005
σ0.007-0.015=-0.007
min0.389-0.389=-0.000
max0.406-0.425=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1322.860-1322.864=-0.004
σ0.101-0.098=0.004
min1322.807-1322.802=0.005
max1323.040-1323.035=0.005
mean1431.000-1665.000=-234.000
σ0.000
min1431.000-1665.000=-234.000
max1431.000-1665.000=-234.000
mean1.903-1.922=-0.019
σ0.093-0.068=0.024
min1.792-1.827=-0.035
max2.009-2.008=0.001
iters=5
new-facts=6402
prior-facts=1
mean1561.315-1561.299=0.016
σ6.902-6.881=0.021
min1558.001-1557.976=0.025
max1573.656-1573.603=0.053
mean1431.000-1665.000=-234.000
σ0.000
min1431.000-1665.000=-234.000
max1431.000-1665.000=-234.000
mean2.336-2.222=0.113
σ0.305-0.203=0.102
min2.122-2.101=0.021
max2.855-2.584=0.271
iters=5
new-facts=6402
prior-facts=6402
mean1890.802-1890.807=-0.005
σ0.025-0.030=-0.004
min1890.781-1890.787=-0.005
max1890.844-1890.857=-0.013
mean1761.400-1791.000=-29.600
σ154.780-108.312=46.468
min1527.000-1665.000=-138.000
max1951.000-1953.000=-2.000
mean2.993-3.021=-0.028
σ0.190-0.166=0.024
min2.804-2.881=-0.076
max3.300-3.288=0.012

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.596-1.133=0.462
σ0.152-0.267=-0.115
min1.454-0.914=0.539
max1.799-1.546=0.254

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.318-443.039=0.278
σ573.956-573.397=0.559
min156.334-156.337=-0.003
max1304.252-1303.135=1.116
mean96.250
σ8.500
min92.000
max109.000
mean1431.000-1665.000=-234.000
σ0.000
min1431.000-1665.000=-234.000
max1431.000-1665.000=-234.000
mean0.534-0.533=0.001
σ0.550-0.543=0.007
min0.257-0.258=-0.001
max1.359-1.347=0.012
policies=20
mean1563.612-1563.639=-0.027
σ0.323-0.339=-0.016
min1563.395-1563.436=-0.042
max1564.092-1564.146=-0.054
mean920.000
σ0.000
min920.000
max920.000
mean1431.000-1665.000=-234.000
σ0.000
min1431.000-1665.000=-234.000
max1431.000-1665.000=-234.000
mean2.590-2.630=-0.040
σ0.019-0.013=0.007
min2.569-2.618=-0.049
max2.610-2.646=-0.036
policies=200
mean15644.066-15644.073=-0.007
σ0.132-0.064=0.069
min15643.970-15644.003=-0.033
max15644.261-15644.154=0.107
mean9200.000
σ0.000
min9200.000
max9200.000
mean1431.000-1665.000=-234.000
σ0.000
min1431.000-1665.000=-234.000
max1431.000-1665.000=-234.000
mean26.411-26.585=-0.174
σ0.158-0.293=-0.135
min26.253-26.333=-0.081
max26.587-26.951=-0.364