Compare commits

Home / Compare b7d8d45f .. 2a5bd02c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.836-53.838=-0.001
σ0.368-0.367=0.001
min53.693-53.689=0.004
max54.883-54.882=0.001
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.138-0.146=-0.008
σ0.004-0.011=-0.007
min0.132-0.134=-0.002
max0.144-0.167=-0.022
cache=y
dps=1
iters=10
policies=100
mean43.207-43.208=-0.001
σ0.007-0.008=-0.001
min43.196-43.195=0.001
max43.221-43.221=0.000
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.119-0.121=-0.002
σ0.005-0.004=0.000
min0.114-0.114=-0.000
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.206-1016.204=0.002
σ1.165-1.173=-0.008
min1015.657-1015.651=0.006
max1021.081-1021.110=-0.029
mean1042.150-1051.250=-9.100
σ310.346-311.876=-1.530
min588.000-559.000=29.000
max1629.000-1517.000=112.000
mean1.557-1.556=0.002
σ0.070-0.071=-0.001
min1.489-1.485=0.004
max1.799-1.752=0.047

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.407-301.443=-0.036
σ0.238-0.218=0.020
min301.204-301.299=-0.096
max302.043-302.044=-0.001
mean1950.000-2038.000=-88.000
σ0.000
min1950.000-2038.000=-88.000
max1950.000-2038.000=-88.000
mean0.593-0.556=0.037
σ0.028-0.036=-0.008
min0.517-0.501=0.016
max0.610-0.597=0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.469-301.473=-0.004
σ0.064-0.059=0.004
min301.364-301.384=-0.020
max301.526-301.538=-0.012
mean1629.000-1517.000=112.000
σ0.000
min1629.000-1517.000=112.000
max1629.000-1517.000=112.000
mean0.390-0.390=0.000
σ0.001-0.002=-0.001
min0.389-0.388=0.001
max0.392-0.393=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1324.048-1324.055=-0.007
σ0.104-0.102=0.001
min1323.919-1323.922=-0.002
max1324.197-1324.171=0.026
mean1629.000-1517.000=112.000
σ0.000
min1629.000-1517.000=112.000
max1629.000-1517.000=112.000
mean1.900-1.894=0.006
σ0.069-0.060=0.009
min1.815-1.834=-0.019
max1.984-1.966=0.018
iters=5
new-facts=6402
prior-facts=1
mean1562.095-1562.083=0.012
σ6.936-6.882=0.055
min1558.725-1558.827=-0.102
max1574.496-1574.389=0.107
mean1629.000-1517.000=112.000
σ0.000
min1629.000-1517.000=112.000
max1629.000-1517.000=112.000
mean2.390-2.306=0.084
σ0.344-0.279=0.065
min2.105-2.081=0.024
max2.891-2.722=0.169
iters=5
new-facts=6402
prior-facts=6402
mean1891.983-1891.965=0.018
σ0.073-0.065=0.009
min1891.853-1891.857=-0.004
max1892.032-1892.010=0.022
mean1780.200-1734.600=45.600
σ115.697-212.738=-97.041
min1629.000-1517.000=112.000
max1950.000-2038.000=-88.000
mean2.969-2.930=0.039
σ0.142-0.135=0.008
min2.863-2.847=0.016
max3.206-3.168=0.038

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.209-1.465=-0.256
σ0.280-0.261=0.019
min0.918-1.167=-0.249
max1.656-1.744=-0.087

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.493-443.485=0.007
σ574.249-574.241=0.008
min156.368-156.362=0.006
max1304.866-1304.846=0.019
mean96.250
σ8.500
min92.000
max109.000
mean1629.000-1517.000=112.000
σ0.000
min1629.000-1517.000=112.000
max1629.000-1517.000=112.000
mean0.531-0.548=-0.017
σ0.539-0.579=-0.040
min0.260-0.251=0.009
max1.340-1.417=-0.077
policies=20
mean1563.921-1563.899=0.022
σ0.327-0.331=-0.004
min1563.738-1563.676=0.062
max1564.411-1564.391=0.020
mean920.000
σ0.000
min920.000
max920.000
mean1629.000-1517.000=112.000
σ0.000
min1629.000-1517.000=112.000
max1629.000-1517.000=112.000
mean2.619-2.604=0.015
σ0.017-0.017=-0.000
min2.606-2.582=0.023
max2.642-2.622=0.020
policies=200
mean15647.016-15646.969=0.048
σ0.077-0.034=0.043
min15646.952-15646.924=0.029
max15647.128-15647.005=0.123
mean9200.000
σ0.000
min9200.000
max9200.000
mean1629.000-1517.000=112.000
σ0.000
min1629.000-1517.000=112.000
max1629.000-1517.000=112.000
mean26.510-26.407=0.103
σ0.180-0.147=0.033
min26.337-26.271=0.065
max26.734-26.567=0.167