Compare commits

Home / Compare 36382df3 .. 7ce469c6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.835-53.835=0.000
σ0.367-0.369=-0.002
min53.697-53.693=0.003
max54.881-54.886=-0.005
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.137-0.139=-0.002
σ0.005-0.006=-0.001
min0.130-0.134=-0.004
max0.144-0.150=-0.006
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=0.000
σ0.007-0.006=0.000
min43.201-43.198=0.002
max43.221-43.221=0.000
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.121-0.121=-0.000
σ0.003-0.004=-0.001
min0.117-0.118=-0.000
max0.126-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.203-1016.205=-0.002
σ1.164-1.164=-0.000
min1015.641-1015.631=0.010
max1021.073-1021.077=-0.004
mean1041.000-1046.050=-5.050
σ309.608-311.387=-1.779
min596.000-554.000=42.000
max1626.000-1511.000=115.000
mean1.544-1.517=0.027
σ0.096-0.059=0.037
min1.456-1.442=0.013
max1.801-1.658=0.143

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.333-301.302=0.031
σ0.299-0.242=0.057
min301.095-301.159=-0.065
max302.138-301.979=0.159
mean2013.000-2038.000=-25.000
σ0.000
min2013.000-2038.000=-25.000
max2013.000-2038.000=-25.000
mean0.543-0.587=-0.043
σ0.038-0.009=0.029
min0.507-0.576=-0.069
max0.598-0.602=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.475-301.484=-0.009
σ0.055-0.041=0.014
min301.392-301.421=-0.029
max301.532-301.526=0.005
mean1626.000-1511.000=115.000
σ0.000
min1626.000-1511.000=115.000
max1626.000-1511.000=115.000
mean0.393-0.393=0.000
σ0.004-0.001=0.003
min0.390-0.392=-0.003
max0.398-0.395=0.003
iters=5
new-facts=1
prior-facts=6402
mean1324.061-1324.070=-0.009
σ0.109-0.118=-0.008
min1323.923-1323.926=-0.003
max1324.185-1324.211=-0.026
mean1626.000-1511.000=115.000
σ0.000
min1626.000-1511.000=115.000
max1626.000-1511.000=115.000
mean1.921-1.905=0.015
σ0.083-0.107=-0.023
min1.829-1.771=0.058
max2.015-2.033=-0.019
iters=5
new-facts=6402
prior-facts=1
mean1562.119-1562.071=0.048
σ6.909-6.924=-0.014
min1558.809-1558.759=0.050
max1574.474-1574.451=0.023
mean1626.000-1511.000=115.000
σ0.000
min1626.000-1511.000=115.000
max1626.000-1511.000=115.000
mean2.435-2.253=0.181
σ0.354-0.248=0.106
min2.035-2.045=-0.010
max2.843-2.658=0.185
iters=5
new-facts=6402
prior-facts=6402
mean1891.967-1891.934=0.033
σ0.064-0.062=0.002
min1891.858-1891.852=0.007
max1892.012-1892.004=0.008
mean1769.000-1739.200=29.800
σ167.313-225.617=-58.305
min1626.000-1511.000=115.000
max2013.000-2038.000=-25.000
mean2.889-2.979=-0.089
σ0.099-0.153=-0.054
min2.756-2.856=-0.101
max3.032-3.155=-0.122

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.217-1.516=-0.299
σ0.296-0.402=-0.106
min0.924-0.935=-0.011
max1.699-1.829=-0.130

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.489-443.484=0.005
σ574.240-574.236=0.004
min156.368-156.362=0.006
max1304.849-1304.838=0.012
mean96.250
σ8.500
min92.000
max109.000
mean1626.000-1511.000=115.000
σ0.000
min1626.000-1511.000=115.000
max1626.000-1511.000=115.000
mean0.522-0.542=-0.020
σ0.522-0.563=-0.040
min0.260-0.260=0.000
max1.305-1.386=-0.081
policies=20
mean1563.913-1563.904=0.009
σ0.323-0.334=-0.011
min1563.719-1563.692=0.028
max1564.397-1564.402=-0.005
mean920.000
σ0.000
min920.000
max920.000
mean1626.000-1511.000=115.000
σ0.000
min1626.000-1511.000=115.000
max1626.000-1511.000=115.000
mean2.606-2.611=-0.005
σ0.012-0.012=-0.000
min2.589-2.600=-0.011
max2.618-2.628=-0.011
policies=200
mean15646.942-15647.012=-0.070
σ0.175-0.074=0.101
min15646.769-15646.929=-0.160
max15647.184-15647.110=0.074
mean9200.000
σ0.000
min9200.000
max9200.000
mean1626.000-1511.000=115.000
σ0.000
min1626.000-1511.000=115.000
max1626.000-1511.000=115.000
mean26.546-26.404=0.142
σ0.231-0.133=0.099
min26.353-26.209=0.144
max26.866-26.495=0.370