Compare commits

Home / Compare 532b443f .. ef6e162a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.836-53.836=0.000
σ0.367-0.367=-0.000
min53.691-53.689=0.002
max54.879-54.879=-0.001
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.139-0.140=-0.000
σ0.004-0.005=-0.001
min0.136-0.132=0.004
max0.147-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.210-43.208=0.001
σ0.006-0.007=-0.001
min43.198-43.198=-0.000
max43.218-43.219=-0.001
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.127-0.121=0.006
σ0.011-0.003=0.008
min0.115-0.119=-0.004
max0.146-0.126=0.019

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.207-1016.207=0.000
σ1.161-1.175=-0.013
min1015.630-1015.632=-0.002
max1021.068-1021.123=-0.055
mean1044.200-1049.600=-5.400
σ310.750-311.477=-0.727
min579.000-557.000=22.000
max1631.000-1514.000=117.000
mean1.533-1.527=0.006
σ0.095-0.050=0.046
min1.444-1.472=-0.028
max1.816-1.664=0.151

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.216-301.339=-0.123
σ0.242-0.218=0.024
min301.038-301.201=-0.163
max301.887-301.943=-0.055
mean1960.000-2039.000=-79.000
σ0.000
min1960.000-2039.000=-79.000
max1960.000-2039.000=-79.000
mean0.548-0.562=-0.015
σ0.036-0.031=0.005
min0.506-0.501=0.005
max0.599-0.587=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.484-301.488=-0.004
σ0.042-0.031=0.011
min301.418-301.452=-0.034
max301.530-301.532=-0.002
mean1631.000-1514.000=117.000
σ0.000
min1631.000-1514.000=117.000
max1631.000-1514.000=117.000
mean0.393-0.391=0.001
σ0.006-0.007=-0.001
min0.387-0.386=0.001
max0.401-0.404=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1324.053-1324.064=-0.011
σ0.098-0.114=-0.017
min1323.926-1323.924=0.002
max1324.172-1324.198=-0.026
mean1631.000-1514.000=117.000
σ0.000
min1631.000-1514.000=117.000
max1631.000-1514.000=117.000
mean1.934-1.888=0.046
σ0.120-0.064=0.056
min1.830-1.824=0.006
max2.142-1.955=0.186
iters=5
new-facts=6402
prior-facts=1
mean1562.101-1562.080=0.021
σ6.927-6.916=0.011
min1558.754-1558.751=0.004
max1574.487-1574.445=0.041
mean1631.000-1514.000=117.000
σ0.000
min1631.000-1514.000=117.000
max1631.000-1514.000=117.000
mean2.379-2.315=0.064
σ0.295-0.244=0.051
min2.126-2.041=0.085
max2.851-2.703=0.148
iters=5
new-facts=6402
prior-facts=6402
mean1891.971-1891.951=0.020
σ0.075-0.066=0.009
min1891.844-1891.856=-0.012
max1892.028-1892.019=0.010
mean1763.200-1733.800=29.400
σ137.812-215.183=-77.371
min1631.000-1514.000=117.000
max1960.000-2039.000=-79.000
mean2.894-2.887=0.007
σ0.077-0.128=-0.051
min2.814-2.711=0.103
max3.010-3.071=-0.061

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.195-1.527=-0.332
σ0.361-0.308=0.053
min0.907-1.165=-0.258
max1.750-1.808=-0.058

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.490-443.483=0.007
σ574.249-574.236=0.013
min156.361-156.361=-0.000
max1304.863-1304.836=0.026
mean96.250
σ8.500
min92.000
max109.000
mean1631.000-1514.000=117.000
σ0.000
min1631.000-1514.000=117.000
max1631.000-1514.000=117.000
mean0.534-0.529=0.005
σ0.552-0.533=0.019
min0.258-0.258=0.000
max1.362-1.328=0.034
policies=20
mean1563.920-1563.901=0.018
σ0.317-0.335=-0.018
min1563.751-1563.682=0.069
max1564.395-1564.400=-0.005
mean920.000
σ0.000
min920.000
max920.000
mean1631.000-1514.000=117.000
σ0.000
min1631.000-1514.000=117.000
max1631.000-1514.000=117.000
mean2.606-2.604=0.001
σ0.009-0.020=-0.011
min2.596-2.578=0.018
max2.618-2.627=-0.009
policies=200
mean15646.906-15646.861=0.046
σ0.104-0.050=0.054
min15646.771-15646.793=-0.022
max15646.990-15646.908=0.083
mean9200.000
σ0.000
min9200.000
max9200.000
mean1631.000-1514.000=117.000
σ0.000
min1631.000-1514.000=117.000
max1631.000-1514.000=117.000
mean26.271-26.395=-0.124
σ0.153-0.177=-0.024
min26.095-26.169=-0.074
max26.452-26.563=-0.111