Compare commits

Home / Compare 4e928a6b .. 52e0ca4b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.836-53.823=0.013
σ0.370-0.367=0.003
min53.691-53.679=0.012
max54.889-54.868=0.022
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.139-0.139=0.000
σ0.004-0.004=-0.000
min0.135-0.131=0.004
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.209-43.208=0.002
σ0.006-0.005=0.001
min43.199-43.202=-0.002
max43.219-43.215=0.004
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.122-0.121=0.001
σ0.003-0.002=0.001
min0.119-0.118=0.001
max0.127-0.126=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.204-1016.175=0.029
σ1.165-1.172=-0.007
min1015.641-1015.631=0.011
max1021.082-1021.087=-0.005
mean1048.600-1053.550=-4.950
σ304.672-314.731=-10.059
min590.000-587.000=3.000
max1632.000-1672.000=-40.000
mean1.542-1.548=-0.006
σ0.081-0.083=-0.003
min1.471-1.445=0.026
max1.789-1.794=-0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.168-301.509=-0.341
σ0.247-0.245=0.002
min301.007-301.297=-0.290
max301.840-302.158=-0.318
mean1952.000-1949.000=3.000
σ0.000
min1952.000-1949.000=3.000
max1952.000-1949.000=3.000
mean0.585-0.563=0.022
σ0.009-0.036=-0.027
min0.573-0.505=0.068
max0.601-0.599=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.720-300.701=0.019
σ0.022-0.022=-0.000
min300.689-300.666=0.023
max300.740-300.724=0.016
mean1632.000-1672.000=-40.000
σ0.000
min1632.000-1672.000=-40.000
max1632.000-1672.000=-40.000
mean0.394-0.397=-0.003
σ0.007-0.009=-0.001
min0.387-0.388=-0.001
max0.402-0.408=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1322.881-1322.863=0.018
σ0.100-0.099=0.001
min1322.824-1322.802=0.023
max1323.059-1323.037=0.022
mean1632.000-1672.000=-40.000
σ0.000
min1632.000-1672.000=-40.000
max1632.000-1672.000=-40.000
mean1.907-1.925=-0.018
σ0.074-0.079=-0.005
min1.809-1.824=-0.016
max2.005-2.037=-0.031
iters=5
new-facts=6402
prior-facts=1
mean1561.324-1561.301=0.022
σ6.891-6.888=0.003
min1557.991-1557.970=0.021
max1573.644-1573.617=0.027
mean1632.000-1672.000=-40.000
σ0.000
min1632.000-1672.000=-40.000
max1632.000-1672.000=-40.000
mean2.269-2.235=0.034
σ0.227-0.258=-0.031
min2.106-2.056=0.051
max2.662-2.685=-0.024
iters=5
new-facts=6402
prior-facts=6402
mean1890.817-1890.805=0.012
σ0.020-0.028=-0.008
min1890.801-1890.786=0.015
max1890.851-1890.852=-0.000
mean1783.000-1784.000=-1.000
σ118.157-104.960=13.197
min1632.000-1672.000=-40.000
max1952.000-1949.000=3.000
mean2.972-3.183=-0.212
σ0.145-0.398=-0.253
min2.838-2.863=-0.024
max3.199-3.831=-0.632

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.112=0.077
σ0.343-0.239=0.103
min0.930-0.899=0.031
max1.758-1.424=0.333

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.490-443.319=0.171
σ574.245-573.962=0.283
min156.366-156.335=0.031
max1304.857-1304.262=0.595
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1672.000=-40.000
σ0.000
min1632.000-1672.000=-40.000
max1632.000-1672.000=-40.000
mean0.531-0.555=-0.024
σ0.537-0.584=-0.047
min0.260-0.261=-0.001
max1.337-1.432=-0.095
policies=20
mean1563.923-1563.641=0.282
σ0.337-0.323=0.014
min1563.739-1563.463=0.276
max1564.427-1564.125=0.302
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1672.000=-40.000
σ0.000
min1632.000-1672.000=-40.000
max1632.000-1672.000=-40.000
mean2.624-2.616=0.008
σ0.012-0.011=0.001
min2.613-2.606=0.007
max2.641-2.626=0.014
policies=200
mean15646.916-15644.143=2.772
σ0.073-0.081=-0.008
min15646.842-15644.078=2.764
max15647.002-15644.262=2.740
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1672.000=-40.000
σ0.000
min1632.000-1672.000=-40.000
max1632.000-1672.000=-40.000
mean26.438-26.436=0.001
σ0.158-0.185=-0.028
min26.294-26.271=0.023
max26.599-26.636=-0.037