Compare commits

Home / Compare 62f74bba .. 1bda9b98

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.820=0.002
σ0.370-0.366=0.004
min53.678-53.674=0.005
max54.875-54.860=0.015
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.139-0.138=0.001
σ0.003-0.004=-0.001
min0.137-0.130=0.007
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean43.207-43.207=0.001
σ0.007-0.006=0.001
min43.198-43.199=-0.001
max43.219-43.214=0.005
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.118-0.117=0.002
σ0.004-0.004=-0.000
min0.114-0.113=0.001
max0.125-0.123=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.185-1016.179=0.006
σ1.148-1.179=-0.031
min1015.604-1015.615=-0.011
max1020.974-1021.117=-0.144
mean1041.550-1046.900=-5.350
σ311.469-297.836=13.633
min587.000-575.000=12.000
max1634.000-1446.000=188.000
mean1.554-1.552=0.002
σ0.083-0.056=0.027
min1.475-1.498=-0.023
max1.817-1.711=0.106

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.226-301.256=-0.031
σ0.219-0.241=-0.023
min301.071-301.113=-0.042
max301.819-301.924=-0.105
mean2020.000-1934.000=86.000
σ0.000
min2020.000-1934.000=86.000
max2020.000-1934.000=86.000
mean0.559-0.586=-0.027
σ0.026-0.032=-0.006
min0.513-0.506=0.007
max0.583-0.612=-0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.696-300.671=0.025
σ0.026-0.037=-0.011
min300.655-300.616=0.039
max300.723-300.708=0.015
mean1634.000-1446.000=188.000
σ0.000
min1634.000-1446.000=188.000
max1634.000-1446.000=188.000
mean0.394-0.396=-0.002
σ0.007-0.005=0.002
min0.388-0.391=-0.002
max0.403-0.401=0.002
iters=5
new-facts=1
prior-facts=6402
mean1322.866-1322.856=0.011
σ0.089-0.108=-0.018
min1322.814-1322.772=0.042
max1323.023-1323.043=-0.019
mean1634.000-1446.000=188.000
σ0.000
min1634.000-1446.000=188.000
max1634.000-1446.000=188.000
mean1.920-1.912=0.007
σ0.070-0.080=-0.011
min1.841-1.822=0.019
max1.986-2.001=-0.014
iters=5
new-facts=6402
prior-facts=1
mean1561.312-1561.338=-0.026
σ6.868-6.872=-0.005
min1558.019-1558.017=0.002
max1573.592-1573.626=-0.035
mean1634.000-1446.000=188.000
σ0.000
min1634.000-1446.000=188.000
max1634.000-1446.000=188.000
mean2.328-2.405=-0.078
σ0.281-0.235=0.046
min2.070-2.164=-0.094
max2.651-2.681=-0.030
iters=5
new-facts=6402
prior-facts=6402
mean1890.787-1890.796=-0.009
σ0.018-0.031=-0.013
min1890.760-1890.771=-0.011
max1890.808-1890.849=-0.041
mean1772.000-1739.000=33.000
σ166.535-195.446=-28.910
min1634.000-1498.000=136.000
max2020.000-1934.000=86.000
mean2.907-3.208=-0.300
σ0.145-0.414=-0.269
min2.733-2.874=-0.142
max3.136-3.852=-0.716

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.167-1.743=-0.576
σ0.393-0.107=0.287
min0.921-1.561=-0.640
max1.861-1.818=0.043

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.322-443.308=0.014
σ573.972-573.947=0.024
min156.334-156.329=0.005
max1304.279-1304.229=0.050
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1446.000=188.000
σ0.000
min1634.000-1446.000=188.000
max1634.000-1446.000=188.000
mean0.525-0.519=0.007
σ0.529-0.511=0.019
min0.261-0.261=-0.000
max1.319-1.285=0.035
policies=20
mean1563.633-1563.607=0.026
σ0.315-0.330=-0.014
min1563.462-1563.397=0.065
max1564.106-1564.099=0.007
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1446.000=188.000
σ0.000
min1634.000-1446.000=188.000
max1634.000-1446.000=188.000
mean2.608-2.607=0.001
σ0.015-0.010=0.005
min2.594-2.595=-0.001
max2.629-2.619=0.010
policies=200
mean15644.110-15644.182=-0.073
σ0.014-0.090=-0.076
min15644.095-15644.055=0.040
max15644.129-15644.265=-0.136
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1446.000=188.000
σ0.000
min1634.000-1446.000=188.000
max1634.000-1446.000=188.000
mean26.558-26.447=0.111
σ0.207-0.211=-0.004
min26.335-26.325=0.010
max26.778-26.762=0.016