Compare commits

Home / Compare eadf5de2 .. db988c73

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.653=0.001
σ0.369-0.366=0.003
min53.509-53.509=-0.000
max54.702-54.693=0.010
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.136-0.138=-0.002
σ0.004-0.003=0.001
min0.131-0.136=-0.005
max0.142-0.144=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.979-42.981=-0.001
σ0.006-0.005=0.001
min42.969-42.973=-0.004
max42.992-42.989=0.002
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.121-0.122=-0.001
σ0.003-0.004=-0.001
min0.118-0.119=-0.001
max0.127-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.978-1013.975=0.003
σ1.159-1.194=-0.035
min1013.422-1013.434=-0.012
max1018.821-1018.980=-0.160
mean1051.150-1077.500=-26.350
σ319.572-320.076=-0.504
min600.000-562.000=38.000
max1660.000-1633.000=27.000
mean1.595-1.642=-0.047
σ0.072-0.074=-0.002
min1.527-1.551=-0.024
max1.826-1.809=0.016

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.315-299.176=0.139
σ0.221-0.248=-0.027
min299.131-299.011=0.120
max299.922-299.853=0.069
mean2049.000-2038.000=11.000
σ0.000
min2049.000-2038.000=11.000
max2049.000-2038.000=11.000
mean0.592-0.576=0.017
σ0.020-0.019=0.002
min0.553-0.548=0.004
max0.617-0.598=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.682-294.679=0.003
σ0.015-0.010=0.005
min294.660-294.663=-0.003
max294.703-294.688=0.015
mean1660.000-1633.000=27.000
σ0.000
min1660.000-1633.000=27.000
max1660.000-1633.000=27.000
mean0.376-0.384=-0.008
σ0.005-0.007=-0.002
min0.373-0.379=-0.006
max0.385-0.394=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1316.942-1316.944=-0.003
σ0.102-0.102=0.000
min1316.881-1316.895=-0.014
max1317.122-1317.126=-0.004
mean1660.000-1633.000=27.000
σ0.000
min1660.000-1633.000=27.000
max1660.000-1633.000=27.000
mean1.975-1.942=0.034
σ0.094-0.090=0.003
min1.878-1.849=0.028
max2.117-2.069=0.048
iters=5
new-facts=6402
prior-facts=1
mean1555.285-1555.286=-0.000
σ6.877-6.863=0.014
min1551.979-1551.957=0.022
max1567.581-1567.556=0.025
mean1660.000-1633.000=27.000
σ0.000
min1660.000-1633.000=27.000
max1660.000-1633.000=27.000
mean2.270-2.249=0.021
σ0.307-0.229=0.078
min2.104-2.094=0.010
max2.817-2.649=0.168
iters=5
new-facts=6402
prior-facts=6402
mean1884.773-1884.775=-0.003
σ0.024-0.028=-0.004
min1884.742-1884.757=-0.015
max1884.799-1884.824=-0.025
mean1796.000-1772.400=23.600
σ168.925-169.642=-0.717
min1660.000-1633.000=27.000
max2049.000-2038.000=11.000
mean2.954-3.004=-0.050
σ0.148-0.186=-0.038
min2.748-2.854=-0.106
max3.134-3.262=-0.127

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.177-1.223=-0.046
σ0.358-0.379=-0.021
min0.915-0.902=0.013
max1.771-1.758=0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.684-440.679=0.005
σ573.411-573.411=0.000
min153.973-153.966=0.007
max1300.800-1300.795=0.005
mean96.250
σ8.500
min92.000
max109.000
mean1660.000-1633.000=27.000
σ0.000
min1660.000-1633.000=27.000
max1660.000-1633.000=27.000
mean0.548-0.552=-0.004
σ0.563-0.563=0.000
min0.261-0.263=-0.003
max1.392-1.395=-0.003
policies=20
mean1539.914-1539.911=0.004
σ0.313-0.325=-0.012
min1539.739-1539.710=0.029
max1540.384-1540.397=-0.013
mean920.000
σ0.000
min920.000
max920.000
mean1660.000-1633.000=27.000
σ0.000
min1660.000-1633.000=27.000
max1660.000-1633.000=27.000
mean2.605-2.600=0.005
σ0.028-0.014=0.015
min2.569-2.589=-0.020
max2.637-2.620=0.018
policies=200
mean15406.590-15407.066=-0.477
σ0.603-0.104=0.499
min15405.687-15406.918=-1.231
max15406.927-15407.159=-0.232
mean9200.000
σ0.000
min9200.000
max9200.000
mean1660.000-1633.000=27.000
σ0.000
min1660.000-1633.000=27.000
max1660.000-1633.000=27.000
mean26.265-26.253=0.012
σ0.127-0.126=0.001
min26.112-26.071=0.041
max26.407-26.345=0.062