Compare commits

Home / Compare 1ae6764b .. 68ee7e9a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.837-53.838=-0.001
σ0.365-0.368=-0.003
min53.697-53.698=-0.002
max54.875-54.885=-0.010
mean413.800-415.000=-1.200
σ0.422-0.000=0.422
min413.000-415.000=-2.000
max414.000-415.000=-1.000
mean0.138-0.142=-0.004
σ0.006-0.010=-0.004
min0.130-0.132=-0.002
max0.148-0.159=-0.010
cache=y
dps=1
iters=10
policies=100
mean43.207-43.207=0.000
σ0.005-0.008=-0.002
min43.200-43.196=0.005
max43.218-43.223=-0.005
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.121-0.120=0.002
σ0.003-0.005=-0.002
min0.118-0.114=0.005
max0.128-0.132=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.205-1016.208=-0.003
σ1.167-1.183=-0.016
min1015.639-1015.629=0.009
max1021.094-1021.162=-0.068
mean1051.950-1047.400=4.550
σ313.460-311.298=2.162
min587.000-555.000=32.000
max1674.000-1511.000=163.000
mean1.561-1.524=0.037
σ0.069-0.079=-0.010
min1.492-1.363=0.130
max1.732-1.723=0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.484-301.320=0.164
σ0.225-0.262=-0.036
min301.334-301.027=0.307
max302.112-301.929=0.182
mean2016.000-2013.000=3.000
σ0.000
min2016.000-2013.000=3.000
max2016.000-2013.000=3.000
mean0.559-0.543=0.016
σ0.031-0.036=-0.005
min0.502-0.502=0.000
max0.597-0.592=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.476-301.469=0.008
σ0.054-0.065=-0.011
min301.391-301.365=0.025
max301.528-301.526=0.002
mean1674.000-1511.000=163.000
σ0.000
min1674.000-1511.000=163.000
max1674.000-1511.000=163.000
mean0.388-0.389=-0.001
σ0.002-0.001=0.001
min0.387-0.389=-0.002
max0.391-0.390=0.001
iters=5
new-facts=1
prior-facts=6402
mean1324.066-1324.057=0.010
σ0.113-0.105=0.008
min1323.927-1323.927=0.000
max1324.198-1324.184=0.014
mean1674.000-1511.000=163.000
σ0.000
min1674.000-1511.000=163.000
max1674.000-1511.000=163.000
mean1.918-1.940=-0.022
σ0.102-0.107=-0.004
min1.825-1.832=-0.007
max2.032-2.057=-0.024
iters=5
new-facts=6402
prior-facts=1
mean1562.087-1562.121=-0.034
σ6.874-6.862=0.012
min1558.816-1558.870=-0.054
max1574.379-1574.392=-0.013
mean1674.000-1511.000=163.000
σ0.000
min1674.000-1511.000=163.000
max1674.000-1511.000=163.000
mean2.307-2.379=-0.072
σ0.212-0.213=-0.002
min2.062-2.068=-0.007
max2.587-2.614=-0.027
iters=5
new-facts=6402
prior-facts=6402
mean1891.973-1891.977=-0.004
σ0.066-0.067=-0.001
min1891.855-1891.860=-0.005
max1892.014-1892.025=-0.011
mean1779.200-1717.600=61.600
σ145.064-206.237=-61.173
min1674.000-1511.000=163.000
max2016.000-2013.000=3.000
mean3.005-3.027=-0.022
σ0.182-0.215=-0.033
min2.870-2.861=0.009
max3.269-3.348=-0.079

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.158-1.489=-0.331
σ0.322-0.333=-0.011
min0.914-1.043=-0.128
max1.689-1.783=-0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.734-443.730=0.005
σ574.739-574.729=0.010
min156.361-156.361=-0.000
max1305.842-1305.822=0.020
mean96.250
σ8.500
min92.000
max109.000
mean1674.000-1511.000=163.000
σ0.000
min1674.000-1511.000=163.000
max1674.000-1511.000=163.000
mean0.539-0.537=0.002
σ0.558-0.550=0.007
min0.257-0.259=-0.002
max1.376-1.363=0.013
policies=20
mean1563.915-1563.887=0.028
σ0.323-0.336=-0.012
min1563.734-1563.666=0.068
max1564.399-1564.387=0.012
mean920.000
σ0.000
min920.000
max920.000
mean1674.000-1511.000=163.000
σ0.000
min1674.000-1511.000=163.000
max1674.000-1511.000=163.000
mean2.608-2.612=-0.004
σ0.006-0.009=-0.003
min2.601-2.604=-0.003
max2.615-2.624=-0.009
policies=200
mean15646.920-15646.943=-0.024
σ0.060-0.116=-0.056
min15646.854-15646.806=0.048
max15646.982-15647.087=-0.105
mean9200.000
σ0.000
min9200.000
max9200.000
mean1674.000-1511.000=163.000
σ0.000
min1674.000-1511.000=163.000
max1674.000-1511.000=163.000
mean26.316-26.410=-0.094
σ0.159-0.206=-0.047
min26.148-26.187=-0.040
max26.460-26.628=-0.168