Compare commits

Home / Compare 707e4bb1 .. 180b9ad5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.830-53.823=0.007
σ0.369-0.368=0.001
min53.686-53.682=0.004
max54.879-54.870=0.009
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.161-0.139=0.022
σ0.003-0.004=-0.001
min0.158-0.133=0.025
max0.169-0.149=0.020
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=-0.000
σ0.008-0.006=0.001
min43.197-43.202=-0.005
max43.222-43.223=-0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.122-0.119=0.002
σ0.010-0.005=0.005
min0.115-0.113=0.001
max0.149-0.127=0.022

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.175-1016.182=-0.007
σ1.189-1.160=0.029
min1015.628-1015.623=0.006
max1021.164-1021.032=0.132
mean1052.450-1042.100=10.350
σ314.864-305.854=9.011
min551.000-586.000=-35.000
max1616.000-1657.000=-41.000
mean1.551-1.568=-0.017
σ0.080-0.106=-0.026
min1.474-1.365=0.109
max1.765-1.819=-0.055

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.198-301.239=-0.042
σ0.221-0.190=0.031
min301.018-301.093=-0.075
max301.804-301.733=0.071
mean1943.000-2030.000=-87.000
σ0.000
min1943.000-2030.000=-87.000
max1943.000-2030.000=-87.000
mean0.567-0.556=0.011
σ0.033-0.031=0.003
min0.510-0.503=0.007
max0.600-0.586=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.709-300.696=0.013
σ0.013-0.032=-0.019
min300.688-300.648=0.040
max300.724-300.731=-0.007
mean1616.000-1657.000=-41.000
σ0.000
min1616.000-1657.000=-41.000
max1616.000-1657.000=-41.000
mean0.399-0.399=0.000
σ0.012-0.008=0.004
min0.389-0.392=-0.003
max0.419-0.411=0.008
iters=5
new-facts=1
prior-facts=6402
mean1322.875-1322.889=-0.014
σ0.099-0.060=0.038
min1322.803-1322.821=-0.018
max1323.030-1322.954=0.076
mean1616.000-1657.000=-41.000
σ0.000
min1616.000-1657.000=-41.000
max1616.000-1657.000=-41.000
mean1.928-2.021=-0.093
σ0.073-0.191=-0.118
min1.835-1.831=0.004
max2.030-2.231=-0.202
iters=5
new-facts=6402
prior-facts=1
mean1561.310-1561.375=-0.065
σ6.900-6.819=0.081
min1557.961-1558.177=-0.216
max1573.646-1573.570=0.076
mean1616.000-1657.000=-41.000
σ0.000
min1616.000-1657.000=-41.000
max1616.000-1657.000=-41.000
mean2.369-2.353=0.016
σ0.374-0.180=0.194
min2.068-2.191=-0.123
max2.884-2.606=0.278
iters=5
new-facts=6402
prior-facts=6402
mean1890.806-1890.790=0.016
σ0.029-0.018=0.011
min1890.783-1890.776=0.007
max1890.856-1890.822=0.034
mean1772.200-1780.400=-8.200
σ119.376-158.037=-38.661
min1616.000-1657.000=-41.000
max1943.000-2030.000=-87.000
mean3.005-2.960=0.044
σ0.172-0.073=0.099
min2.876-2.884=-0.008
max3.292-3.052=0.240

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.200-1.097=0.103
σ0.329-0.206=0.123
min0.905-0.907=-0.003
max1.752-1.328=0.424

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.044-443.042=0.002
σ573.410-573.398=0.012
min156.337-156.338=-0.001
max1303.159-1303.138=0.020
mean96.250
σ8.500
min92.000
max109.000
mean1616.000-1657.000=-41.000
σ0.000
min1616.000-1657.000=-41.000
max1616.000-1657.000=-41.000
mean0.526-0.546=-0.020
σ0.523-0.565=-0.042
min0.260-0.262=-0.001
max1.310-1.392=-0.082
policies=20
mean1563.633-1563.640=-0.007
σ0.330-0.342=-0.013
min1563.442-1563.447=-0.004
max1564.127-1564.153=-0.027
mean920.000
σ0.000
min920.000
max920.000
mean1616.000-1657.000=-41.000
σ0.000
min1616.000-1657.000=-41.000
max1616.000-1657.000=-41.000
mean2.619-2.637=-0.018
σ0.015-0.016=-0.001
min2.609-2.619=-0.010
max2.641-2.653=-0.012
policies=200
mean15644.056-15644.016=0.040
σ0.148-0.149=-0.002
min15643.936-15643.881=0.055
max15644.271-15644.224=0.047
mean9200.000
σ0.000
min9200.000
max9200.000
mean1616.000-1657.000=-41.000
σ0.000
min1616.000-1657.000=-41.000
max1616.000-1657.000=-41.000
mean26.525-26.446=0.079
σ0.100-0.130=-0.030
min26.376-26.295=0.082
max26.597-26.613=-0.016