Compare commits

Home / Compare 1705b3aa .. 1f244fc8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.836-53.836=-0.000
σ0.365-0.369=-0.003
min53.700-53.692=0.008
max54.876-54.885=-0.009
mean415.000-413.700=1.300
σ0.000-0.483=-0.483
min415.000-413.000=2.000
max415.000-414.000=1.000
mean0.138-0.137=0.001
σ0.005-0.004=0.001
min0.131-0.132=-0.001
max0.149-0.143=0.007
cache=y
dps=1
iters=10
policies=100
mean43.208-43.207=0.001
σ0.007-0.006=0.001
min43.199-43.199=-0.000
max43.223-43.217=0.006
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.122-0.121=0.001
σ0.004-0.004=-0.001
min0.119-0.115=0.004
max0.129-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.208-1016.204=0.003
σ1.188-1.183=0.005
min1015.646-1015.642=0.003
max1021.190-1021.164=0.026
mean1051.200-1050.050=1.150
σ316.960-298.368=18.592
min548.000-576.000=-28.000
max1667.000-1449.000=218.000
mean1.562-1.530=0.033
σ0.107-0.062=0.045
min1.449-1.467=-0.018
max1.826-1.705=0.121

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.340-301.340=-0.000
σ0.269-0.212=0.057
min301.088-301.171=-0.083
max302.059-301.902=0.157
mean2034.000-2042.000=-8.000
σ0.000
min2034.000-2042.000=-8.000
max2034.000-2042.000=-8.000
mean0.575-0.547=0.027
σ0.033-0.034=-0.001
min0.506-0.502=0.004
max0.603-0.578=0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.490-301.478=0.011
σ0.036-0.052=-0.016
min301.455-301.399=0.056
max301.535-301.530=0.005
mean1667.000-1449.000=218.000
σ0.000
min1667.000-1449.000=218.000
max1667.000-1449.000=218.000
mean0.391-0.393=-0.001
σ0.007-0.006=0.001
min0.386-0.389=-0.003
max0.403-0.404=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1324.052-1324.059=-0.007
σ0.107-0.113=-0.006
min1323.925-1323.925=0.000
max1324.192-1324.206=-0.013
mean1667.000-1449.000=218.000
σ0.000
min1667.000-1449.000=218.000
max1667.000-1449.000=218.000
mean1.943-1.949=-0.006
σ0.126-0.129=-0.003
min1.846-1.852=-0.007
max2.153-2.142=0.011
iters=5
new-facts=6402
prior-facts=1
mean1562.147-1562.067=0.081
σ6.879-6.911=-0.032
min1558.918-1558.716=0.202
max1574.449-1574.423=0.026
mean1667.000-1449.000=218.000
σ0.000
min1667.000-1449.000=218.000
max1667.000-1449.000=218.000
mean2.449-2.215=0.234
σ0.286-0.202=0.084
min2.083-2.089=-0.006
max2.679-2.571=0.109
iters=5
new-facts=6402
prior-facts=6402
mean1891.964-1891.951=0.012
σ0.062-0.067=-0.006
min1891.855-1891.863=-0.008
max1892.001-1892.012=-0.011
mean1784.200-1720.400=63.800
σ156.773-230.836=-74.063
min1667.000-1449.000=218.000
max2034.000-2042.000=-8.000
mean2.940-2.978=-0.037
σ0.100-0.107=-0.007
min2.876-2.894=-0.017
max3.117-3.133=-0.015

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.166-1.686=-0.520
σ0.384-0.122=0.261
min0.919-1.538=-0.620
max1.841-1.812=0.029

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.941-443.926=0.015
σ575.151-575.132=0.019
min156.363-156.356=0.008
max1306.667-1306.624=0.043
mean96.250
σ8.500
min92.000
max109.000
mean1667.000-1449.000=218.000
σ0.000
min1667.000-1449.000=218.000
max1667.000-1449.000=218.000
mean0.542-0.535=0.007
σ0.565-0.552=0.013
min0.253-0.253=-0.000
max1.390-1.364=0.026
policies=20
mean1563.912-1563.879=0.033
σ0.309-0.322=-0.013
min1563.747-1563.659=0.088
max1564.375-1564.358=0.017
mean920.000
σ0.000
min920.000
max920.000
mean1667.000-1449.000=218.000
σ0.000
min1667.000-1449.000=218.000
max1667.000-1449.000=218.000
mean2.603-2.592=0.010
σ0.007-0.033=-0.026
min2.595-2.563=0.032
max2.611-2.640=-0.029
policies=200
mean15647.012-15646.940=0.072
σ0.073-0.126=-0.052
min15646.965-15646.800=0.165
max15647.121-15647.058=0.063
mean9200.000
σ0.000
min9200.000
max9200.000
mean1667.000-1449.000=218.000
σ0.000
min1667.000-1449.000=218.000
max1667.000-1449.000=218.000
mean26.353-26.317=0.036
σ0.140-0.109=0.030
min26.225-26.221=0.004
max26.510-26.473=0.038