Compare commits

Home / Compare 5aab7652 .. 111175d1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.837-53.836=0.001
σ0.367-0.367=-0.000
min53.690-53.691=-0.001
max54.881-54.881=-0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.138-0.140=-0.002
σ0.004-0.004=-0.000
min0.136-0.136=-0.000
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.207-43.208=-0.000
σ0.005-0.006=-0.001
min43.201-43.195=0.006
max43.217-43.218=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.121-0.123=-0.002
σ0.004-0.006=-0.002
min0.114-0.120=-0.005
max0.128-0.138=-0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.205-1016.208=-0.003
σ1.145-1.160=-0.015
min1015.631-1015.632=-0.002
max1020.990-1021.061=-0.071
mean1041.300-1044.150=-2.850
σ310.619-303.589=7.030
min587.000-585.000=2.000
max1628.000-1624.000=4.000
mean1.535-1.528=0.006
σ0.072-0.071=0.001
min1.473-1.454=0.019
max1.761-1.729=0.032

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.243-301.081=0.161
σ0.224-0.254=-0.030
min301.124-300.802=0.322
max301.873-301.649=0.224
mean2035.000-2027.000=8.000
σ0.000
min2035.000-2027.000=8.000
max2035.000-2027.000=8.000
mean0.560-0.526=0.034
σ0.032-0.027=0.004
min0.496-0.504=-0.008
max0.581-0.579=0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.447-301.475=-0.028
σ0.078-0.042=0.036
min301.324-301.415=-0.091
max301.536-301.529=0.006
mean1628.000-1624.000=4.000
σ0.000
min1628.000-1624.000=4.000
max1628.000-1624.000=4.000
mean0.396-0.396=-0.001
σ0.006-0.006=-0.000
min0.392-0.391=0.001
max0.407-0.406=0.001
iters=5
new-facts=1
prior-facts=6402
mean1324.065-1324.071=-0.006
σ0.113-0.116=-0.003
min1323.926-1323.929=-0.003
max1324.194-1324.205=-0.011
mean1628.000-1624.000=4.000
σ0.000
min1628.000-1624.000=4.000
max1628.000-1624.000=4.000
mean1.913-1.877=0.036
σ0.076-0.057=0.020
min1.832-1.830=0.002
max2.014-1.969=0.045
iters=5
new-facts=6402
prior-facts=1
mean1562.103-1562.081=0.022
σ6.924-6.929=-0.005
min1558.798-1558.772=0.025
max1574.485-1574.469=0.015
mean1628.000-1624.000=4.000
σ0.000
min1628.000-1624.000=4.000
max1628.000-1624.000=4.000
mean2.392-2.266=0.126
σ0.330-0.259=0.071
min2.052-2.010=0.042
max2.780-2.671=0.109
iters=5
new-facts=6402
prior-facts=6402
mean1891.968-1891.970=-0.002
σ0.063-0.067=-0.003
min1891.856-1891.851=0.004
max1892.009-1892.008=0.001
mean1770.200-1775.000=-4.800
σ172.258-175.697=-3.440
min1628.000-1624.000=4.000
max2035.000-2027.000=8.000
mean2.927-2.949=-0.021
σ0.112-0.147=-0.035
min2.856-2.867=-0.010
max3.124-3.209=-0.085

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.193-1.272=-0.079
σ0.362-0.387=-0.026
min0.923-0.904=0.019
max1.791-1.817=-0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.488-443.489=-0.001
σ574.238-574.244=-0.006
min156.361-156.363=-0.002
max1304.845-1304.854=-0.009
mean96.250
σ8.500
min92.000
max109.000
mean1628.000-1624.000=4.000
σ0.000
min1628.000-1624.000=4.000
max1628.000-1624.000=4.000
mean0.532-0.530=0.003
σ0.537-0.539=-0.002
min0.253-0.260=-0.007
max1.337-1.338=-0.001
policies=20
mean1563.869-1563.914=-0.046
σ0.267-0.335=-0.069
min1563.713-1563.719=-0.007
max1564.268-1564.416=-0.149
mean920.000
σ0.000
min920.000
max920.000
mean1628.000-1624.000=4.000
σ0.000
min1628.000-1624.000=4.000
max1628.000-1624.000=4.000
mean2.615-2.619=-0.003
σ0.017-0.006=0.011
min2.604-2.611=-0.007
max2.640-2.624=0.016
policies=200
mean15646.915-15646.970=-0.055
σ0.198-0.048=0.150
min15646.656-15646.920=-0.264
max15647.114-15647.029=0.085
mean9200.000
σ0.000
min9200.000
max9200.000
mean1628.000-1624.000=4.000
σ0.000
min1628.000-1624.000=4.000
max1628.000-1624.000=4.000
mean26.496-26.503=-0.007
σ0.083-0.155=-0.072
min26.380-26.377=0.003
max26.576-26.698=-0.122