Compare commits

Home / Compare 078f4b82 .. 5f165d44

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.822=0.000
σ0.367-0.369=-0.002
min53.678-53.676=0.002
max54.865-54.871=-0.006
mean416.700-415.000=1.700
σ0.483-0.000=0.483
min416.000-415.000=1.000
max417.000-415.000=2.000
mean0.137-0.139=-0.003
σ0.004-0.003=0.001
min0.130-0.136=-0.006
max0.144-0.144=0.000
cache=y
dps=1
iters=10
policies=100
mean43.207-43.207=-0.000
σ0.005-0.007=-0.001
min43.200-43.195=0.005
max43.218-43.217=0.000
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.118-0.120=-0.003
σ0.002-0.005=-0.003
min0.114-0.114=0.000
max0.120-0.128=-0.009

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.173-1016.178=-0.004
σ1.225-1.163=0.062
min1015.634-1015.629=0.004
max1021.301-1021.041=0.261
mean1049.850-1039.650=10.200
σ313.179-312.790=0.388
min557.000-572.000=-15.000
max1517.000-1636.000=-119.000
mean1.569-1.570=-0.002
σ0.118-0.091=0.028
min1.458-1.489=-0.031
max2.008-1.817=0.191

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.484-301.330=0.154
σ0.225-0.244=-0.018
min301.258-301.202=0.057
max302.082-302.013=0.070
mean1955.000
σ0.000
min1955.000
max1955.000
mean0.560-0.547=0.014
σ0.034-0.029=0.005
min0.499-0.499=-0.001
max0.595-0.573=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.684-300.699=-0.015
σ0.045-0.024=0.021
min300.604-300.668=-0.063
max300.714-300.731=-0.017
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean0.399-0.400=-0.001
σ0.005-0.008=-0.002
min0.391-0.392=-0.001
max0.404-0.409=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1322.859-1322.863=-0.004
σ0.103-0.103=0.000
min1322.809-1322.801=0.007
max1323.044-1323.047=-0.003
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean1.923-1.876=0.047
σ0.087-0.048=0.039
min1.821-1.824=-0.003
max2.038-1.955=0.083
iters=5
new-facts=6402
prior-facts=1
mean1561.304-1561.353=-0.049
σ6.908-6.856=0.053
min1557.992-1557.959=0.033
max1573.657-1573.609=0.048
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean2.287-2.451=-0.163
σ0.272-0.443=-0.171
min2.128-2.140=-0.011
max2.771-3.138=-0.367
iters=5
new-facts=6402
prior-facts=6402
mean1890.805-1890.805=0.000
σ0.032-0.019=0.013
min1890.782-1890.788=-0.006
max1890.861-1890.835=0.025
mean1763.000-1784.400=-21.400
σ156.275-117.967=38.308
min1527.000-1636.000=-109.000
max1955.000
mean3.022-3.011=0.011
σ0.183-0.176=0.007
min2.863-2.887=-0.024
max3.307-3.313=-0.006

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.421-1.275=0.146
σ0.241-0.374=-0.134
min1.171-0.904=0.267
max1.763-1.817=-0.054

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.045-443.045=-0.001
σ573.415-573.414=0.001
min156.332-156.330=0.003
max1303.167-1303.166=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean0.555-0.548=0.008
σ0.587-0.566=0.021
min0.260-0.260=-0.000
max1.436-1.396=0.039
policies=20
mean1563.608-1563.625=-0.016
σ0.327-0.327=-0.000
min1563.407-1563.423=-0.016
max1564.096-1564.113=-0.017
mean920.000
σ0.000
min920.000
max920.000
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean2.611-2.612=-0.002
σ0.015-0.007=0.008
min2.597-2.604=-0.007
max2.629-2.621=0.008
policies=200
mean15644.077-15644.118=-0.040
σ0.095-0.081=0.014
min15643.971-15644.007=-0.036
max15644.173-15644.200=-0.028
mean9200.000
σ0.000
min9200.000
max9200.000
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean26.537-26.495=0.042
σ0.141-0.156=-0.015
min26.385-26.361=0.024
max26.692-26.671=0.021