Compare commits

Home / Compare 1a7154a4 .. acf000c4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.823=-0.000
σ0.368-0.367=0.001
min53.681-53.678=0.004
max54.869-54.867=0.002
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.139-0.138=0.000
σ0.004-0.004=-0.000
min0.132-0.134=-0.002
max0.145-0.145=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.207-43.208=-0.000
σ0.006-0.007=-0.001
min43.198-43.199=-0.000
max43.218-43.219=-0.000
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.122-0.120=0.001
σ0.004-0.004=0.000
min0.118-0.114=0.004
max0.128-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.177-1016.174=0.002
σ1.174-1.194=-0.020
min1015.624-1015.628=-0.004
max1021.095-1021.180=-0.085
mean1047.600-1042.300=5.300
σ309.469-303.959=5.511
min586.000
max1658.000-1654.000=4.000
mean1.588-1.543=0.046
σ0.097-0.100=-0.003
min1.490-1.459=0.031
max1.816-1.817=-0.001

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.470-301.343=0.128
σ0.179-0.216=-0.037
min301.306-301.116=0.190
max301.946-301.890=0.055
mean1980.000-1947.000=33.000
σ0.000
min1980.000-1947.000=33.000
max1980.000-1947.000=33.000
mean0.579-0.552=0.027
σ0.033-0.038=-0.005
min0.506-0.500=0.006
max0.609-0.594=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.702-300.704=-0.002
σ0.025-0.023=0.002
min300.671-300.677=-0.006
max300.733-300.736=-0.003
mean1658.000-1654.000=4.000
σ0.000
min1658.000-1654.000=4.000
max1658.000-1654.000=4.000
mean0.395-0.397=-0.002
σ0.006-0.009=-0.004
min0.390-0.390=-0.000
max0.401-0.412=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1322.859-1322.867=-0.007
σ0.097-0.104=-0.007
min1322.795-1322.786=0.009
max1323.031-1323.040=-0.010
mean1658.000-1654.000=4.000
σ0.000
min1658.000-1654.000=4.000
max1658.000-1654.000=4.000
mean1.872-1.916=-0.044
σ0.070-0.125=-0.055
min1.808-1.747=0.061
max1.978-2.045=-0.067
iters=5
new-facts=6402
prior-facts=1
mean1561.310-1561.294=0.015
σ6.899-6.868=0.031
min1558.002-1557.979=0.023
max1573.645-1573.575=0.071
mean1658.000-1654.000=4.000
σ0.000
min1658.000-1654.000=4.000
max1658.000-1654.000=4.000
mean2.312-2.226=0.086
σ0.272-0.198=0.074
min2.117-2.058=0.059
max2.790-2.553=0.237
iters=5
new-facts=6402
prior-facts=6402
mean1890.793-1890.799=-0.006
σ0.014-0.019=-0.005
min1890.776-1890.780=-0.004
max1890.813-1890.830=-0.017
mean1757.200-1775.200=-18.000
σ138.494-108.080=30.415
min1658.000-1654.000=4.000
max1980.000-1947.000=33.000
mean2.944-2.999=-0.054
σ0.131-0.137=-0.006
min2.728-2.877=-0.149
max3.057-3.196=-0.139

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.060-1.197=-0.138
σ0.184-0.424=-0.239
min0.922-0.909=0.013
max1.315-1.926=-0.611

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.340-443.334=0.006
σ573.988-573.991=-0.004
min156.332-156.338=-0.006
max1304.321-1304.321=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1658.000-1654.000=4.000
σ0.000
min1658.000-1654.000=4.000
max1658.000-1654.000=4.000
mean0.560-0.531=0.029
σ0.596-0.537=0.059
min0.261-0.250=0.011
max1.454-1.336=0.118
policies=20
mean1563.637-1563.619=0.018
σ0.329-0.327=0.002
min1563.448-1563.438=0.011
max1564.129-1564.108=0.021
mean920.000
σ0.000
min920.000
max920.000
mean1658.000-1654.000=4.000
σ0.000
min1658.000-1654.000=4.000
max1658.000-1654.000=4.000
mean2.619-2.622=-0.002
σ0.018-0.018=0.001
min2.608-2.602=0.006
max2.646-2.643=0.004
policies=200
mean15644.174-15644.051=0.122
σ0.065-0.141=-0.077
min15644.127-15643.946=0.180
max15644.266-15644.249=0.017
mean9200.000
σ0.000
min9200.000
max9200.000
mean1658.000-1654.000=4.000
σ0.000
min1658.000-1654.000=4.000
max1658.000-1654.000=4.000
mean26.686-26.392=0.294
σ0.209-0.136=0.073
min26.482-26.244=0.239
max26.977-26.526=0.450