Compare commits

Home / Compare f99ce3e7 .. 432ca27e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.823=-0.001
σ0.369-0.367=0.002
min53.681-53.675=0.006
max54.871-54.866=0.005
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.139-0.139=0.000
σ0.005-0.003=0.001
min0.135-0.135=-0.001
max0.146-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.207-43.208=-0.001
σ0.005-0.006=-0.000
min43.200-43.201=-0.001
max43.215-43.219=-0.004
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.118-0.120=-0.002
σ0.004-0.004=-0.000
min0.113-0.114=-0.002
max0.123-0.127=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.180-1016.176=0.005
σ1.157-1.153=0.005
min1015.610-1015.601=0.009
max1021.018-1020.997=0.021
mean1045.750-1045.850=-0.100
σ311.169-312.288=-1.119
min591.000-553.000=38.000
max1637.000-1512.000=125.000
mean1.571-1.542=0.029
σ0.087-0.043=0.044
min1.478-1.482=-0.004
max1.795-1.629=0.166

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.363-301.281=0.082
σ0.204-0.171=0.033
min301.214-301.187=0.027
max301.898-301.752=0.147
mean1934.000-2027.000=-93.000
σ0.000
min1934.000-2027.000=-93.000
max1934.000-2027.000=-93.000
mean0.544-0.558=-0.014
σ0.030-0.027=0.002
min0.509-0.511=-0.002
max0.574-0.587=-0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.704-300.683=0.021
σ0.016-0.035=-0.019
min300.685-300.633=0.052
max300.729-300.711=0.018
mean1637.000-1512.000=125.000
σ0.000
min1637.000-1512.000=125.000
max1637.000-1512.000=125.000
mean0.395-0.399=-0.004
σ0.008-0.008=0.000
min0.387-0.390=-0.003
max0.405-0.409=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1322.859-1322.875=-0.015
σ0.107-0.099=0.008
min1322.783-1322.817=-0.034
max1323.049-1323.048=0.001
mean1637.000-1512.000=125.000
σ0.000
min1637.000-1512.000=125.000
max1637.000-1512.000=125.000
mean1.936-1.905=0.031
σ0.110-0.088=0.023
min1.842-1.829=0.013
max2.126-2.044=0.082
iters=5
new-facts=6402
prior-facts=1
mean1561.316-1561.303=0.014
σ6.902-6.897=0.005
min1557.965-1557.983=-0.018
max1573.657-1573.634=0.023
mean1637.000-1512.000=125.000
σ0.000
min1637.000-1512.000=125.000
max1637.000-1512.000=125.000
mean2.289-2.266=0.023
σ0.348-0.270=0.078
min1.961-2.107=-0.147
max2.876-2.746=0.131
iters=5
new-facts=6402
prior-facts=6402
mean1890.798-1890.794=0.003
σ0.016-0.012=0.004
min1890.783-1890.782=0.000
max1890.825-1890.812=0.012
mean1772.000-1728.800=43.200
σ108.809-213.482=-104.673
min1637.000-1512.000=125.000
max1934.000-2027.000=-93.000
mean2.990-2.845=0.145
σ0.110-0.102=0.008
min2.886-2.718=0.168
max3.107-2.980=0.127

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.473=-0.284
σ0.328-0.258=0.069
min0.914-1.193=-0.279
max1.740-1.770=-0.030

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.054-443.048=0.006
σ573.435-573.428=0.007
min156.329-156.332=-0.003
max1303.206-1303.190=0.016
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1512.000=125.000
σ0.000
min1637.000-1512.000=125.000
max1637.000-1512.000=125.000
mean0.544-0.541=0.003
σ0.555-0.557=-0.002
min0.266-0.258=0.008
max1.376-1.376=-0.000
policies=20
mean1563.609-1563.608=0.001
σ0.332-0.339=-0.007
min1563.418-1563.394=0.023
max1564.107-1564.114=-0.008
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1512.000=125.000
σ0.000
min1637.000-1512.000=125.000
max1637.000-1512.000=125.000
mean2.625-2.621=0.004
σ0.007-0.015=-0.008
min2.618-2.601=0.017
max2.633-2.637=-0.004
policies=200
mean15643.750-15644.155=-0.405
σ0.337-0.085=0.252
min15643.248-15644.051=-0.803
max15643.971-15644.259=-0.288
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1512.000=125.000
σ0.000
min1637.000-1512.000=125.000
max1637.000-1512.000=125.000
mean26.517-26.554=-0.037
σ0.137-0.155=-0.018
min26.367-26.398=-0.031
max26.638-26.700=-0.062