Compare commits

Home / Compare 3732ea6d .. d8e05132

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.824=-0.002
σ0.369-0.367=0.002
min53.680-53.681=-0.001
max54.873-54.869=0.004
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.137-0.139=-0.002
σ0.004-0.004=-0.000
min0.131-0.135=-0.004
max0.143-0.147=-0.005
cache=y
dps=1
iters=10
policies=100
mean43.207-43.207=0.000
σ0.006-0.007=-0.000
min43.197-43.194=0.003
max43.220-43.217=0.003
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.123-0.120=0.003
σ0.004-0.005=-0.001
min0.119-0.113=0.006
max0.128-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.177-1016.175=0.001
σ1.172-1.171=0.001
min1015.604-1015.616=-0.012
max1021.084-1021.073=0.012
mean1051.000-1045.400=5.600
σ312.158-311.995=0.163
min558.000-553.000=5.000
max1517.000-1512.000=5.000
mean1.550-1.538=0.011
σ0.044-0.051=-0.007
min1.505-1.476=0.028
max1.631-1.665=-0.034

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.329-301.346=-0.017
σ0.180-0.236=-0.055
min301.170-301.165=0.005
max301.797-301.976=-0.179
mean2020.000-2036.000=-16.000
σ0.000
min2020.000-2036.000=-16.000
max2020.000-2036.000=-16.000
mean0.564-0.549=0.015
σ0.037-0.034=0.004
min0.503-0.500=0.003
max0.601-0.578=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.700-300.695=0.004
σ0.026-0.040=-0.014
min300.671-300.633=0.038
max300.737-300.735=0.002
mean1517.000-1512.000=5.000
σ0.000
min1517.000-1512.000=5.000
max1517.000-1512.000=5.000
mean0.392-0.407=-0.015
σ0.006-0.006=0.000
min0.385-0.400=-0.015
max0.399-0.416=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1322.868-1322.871=-0.003
σ0.103-0.104=-0.001
min1322.816-1322.814=0.003
max1323.051-1323.055=-0.004
mean1517.000-1512.000=5.000
σ0.000
min1517.000-1512.000=5.000
max1517.000-1512.000=5.000
mean1.877-1.926=-0.049
σ0.065-0.113=-0.048
min1.812-1.814=-0.002
max1.954-2.069=-0.115
iters=5
new-facts=6402
prior-facts=1
mean1561.308-1561.309=-0.001
σ6.899-6.918=-0.020
min1558.022-1557.977=0.045
max1573.644-1573.680=-0.036
mean1517.000-1512.000=5.000
σ0.000
min1517.000-1512.000=5.000
max1517.000-1512.000=5.000
mean2.298-2.268=0.030
σ0.297-0.290=0.007
min2.064-2.111=-0.047
max2.786-2.785=0.001
iters=5
new-facts=6402
prior-facts=6402
mean1890.803-1890.788=0.015
σ0.026-0.015=0.011
min1890.776-1890.771=0.005
max1890.845-1890.810=0.035
mean1724.600-1735.600=-11.000
σ207.883-219.714=-11.831
min1517.000-1512.000=5.000
max2020.000-2036.000=-16.000
mean2.899-2.918=-0.020
σ0.046-0.122=-0.076
min2.867-2.811=0.056
max2.979-3.128=-0.149

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.548-1.535=0.013
σ0.300-0.149=0.151
min1.217-1.300=-0.082
max1.779-1.680=0.099

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.038-443.036=0.002
σ573.403-573.402=0.001
min156.336-156.330=0.006
max1303.143-1303.139=0.004
mean96.250
σ8.500
min92.000
max109.000
mean1517.000-1512.000=5.000
σ0.000
min1517.000-1512.000=5.000
max1517.000-1512.000=5.000
mean0.539-0.533=0.006
σ0.546-0.539=0.007
min0.264-0.257=0.007
max1.358-1.341=0.017
policies=20
mean1563.618-1563.597=0.022
σ0.334-0.326=0.008
min1563.414-1563.384=0.030
max1564.118-1564.083=0.034
mean920.000
σ0.000
min920.000
max920.000
mean1517.000-1512.000=5.000
σ0.000
min1517.000-1512.000=5.000
max1517.000-1512.000=5.000
mean2.619-2.598=0.021
σ0.009-0.028=-0.020
min2.610-2.570=0.041
max2.630-2.637=-0.007
policies=200
mean15644.052-15644.096=-0.044
σ0.047-0.155=-0.109
min15643.984-15643.960=0.024
max15644.089-15644.277=-0.188
mean9200.000
σ0.000
min9200.000
max9200.000
mean1517.000-1512.000=5.000
σ0.000
min1517.000-1512.000=5.000
max1517.000-1512.000=5.000
mean26.406-26.422=-0.016
σ0.130-0.141=-0.010
min26.291-26.274=0.017
max26.521-26.573=-0.052