Compare commits

Home / Compare 68cd1ac2 .. 125dc8be

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.821-53.822=-0.001
σ0.368-0.367=0.000
min53.676-53.679=-0.003
max54.867-54.867=-0.000
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.139-0.138=0.001
σ0.003-0.003=0.000
min0.136-0.134=0.002
max0.145-0.143=0.002
cache=y
dps=1
iters=10
policies=100
mean43.209-43.209=0.000
σ0.007-0.007=-0.000
min43.199-43.199=0.000
max43.218-43.221=-0.003
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.122-0.121=0.001
σ0.004-0.003=0.001
min0.118-0.119=-0.000
max0.128-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.177-1016.177=-0.000
σ1.168-1.177=-0.009
min1015.600-1015.630=-0.031
max1021.067-1021.108=-0.041
mean1046.150-1052.550=-6.400
σ312.330-311.919=0.411
min554.000-589.000=-35.000
max1513.000-1672.000=-159.000
mean1.549-1.588=-0.039
σ0.052-0.093=-0.041
min1.490-1.504=-0.014
max1.659-1.808=-0.149

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.475-301.246=0.229
σ0.217-0.216=0.000
min301.304-301.003=0.301
max302.062-301.772=0.290
mean2025.000-1958.000=67.000
σ0.000
min2025.000-1958.000=67.000
max2025.000-1958.000=67.000
mean0.551-0.551=-0.000
σ0.034-0.043=-0.009
min0.504-0.502=0.001
max0.599-0.604=-0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.690-300.697=-0.007
σ0.037-0.027=0.010
min300.630-300.665=-0.035
max300.726-300.734=-0.008
mean1513.000-1672.000=-159.000
σ0.000
min1513.000-1672.000=-159.000
max1513.000-1672.000=-159.000
mean0.401-0.395=0.006
σ0.009-0.007=0.002
min0.391-0.389=0.003
max0.411-0.406=0.005
iters=5
new-facts=1
prior-facts=6402
mean1322.870-1322.866=0.004
σ0.088-0.099=-0.012
min1322.816-1322.809=0.007
max1323.022-1323.043=-0.021
mean1513.000-1672.000=-159.000
σ0.000
min1513.000-1672.000=-159.000
max1513.000-1672.000=-159.000
mean1.868-1.944=-0.076
σ0.049-0.088=-0.039
min1.823-1.813=0.009
max1.940-2.031=-0.091
iters=5
new-facts=6402
prior-facts=1
mean1561.322-1561.311=0.011
σ6.880-6.877=0.003
min1558.074-1557.972=0.102
max1573.625-1573.605=0.020
mean1513.000-1672.000=-159.000
σ0.000
min1513.000-1672.000=-159.000
max1513.000-1672.000=-159.000
mean2.345-2.361=-0.016
σ0.343-0.270=0.073
min2.046-2.075=-0.030
max2.727-2.687=0.039
iters=5
new-facts=6402
prior-facts=6402
mean1890.798-1890.806=-0.008
σ0.027-0.032=-0.005
min1890.777-1890.788=-0.011
max1890.844-1890.863=-0.019
mean1726.000-1793.800=-67.800
σ209.645-108.258=101.387
min1513.000-1672.000=-159.000
max2025.000-1958.000=67.000
mean2.900-3.028=-0.128
σ0.053-0.170=-0.117
min2.850-2.900=-0.051
max2.990-3.312=-0.322

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.453-1.045=0.408
σ0.408-0.147=0.261
min0.929-0.903=0.025
max1.832-1.235=0.597

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.040-443.051=-0.011
σ573.399-573.403=-0.004
min156.334-156.339=-0.005
max1303.139-1303.156=-0.017
mean96.250
σ8.500
min92.000
max109.000
mean1513.000-1672.000=-159.000
σ0.000
min1513.000-1672.000=-159.000
max1513.000-1672.000=-159.000
mean0.531-0.524=0.007
σ0.538-0.532=0.007
min0.259-0.242=0.016
max1.338-1.321=0.018
policies=20
mean1563.618-1563.653=-0.035
σ0.334-0.349=-0.015
min1563.408-1563.457=-0.049
max1564.117-1564.176=-0.060
mean920.000
σ0.000
min920.000
max920.000
mean1513.000-1672.000=-159.000
σ0.000
min1513.000-1672.000=-159.000
max1513.000-1672.000=-159.000
mean2.617-2.666=-0.049
σ0.019-0.059=-0.041
min2.597-2.630=-0.032
max2.642-2.755=-0.113
policies=200
mean15644.167-15644.114=0.053
σ0.081-0.025=0.056
min15644.104-15644.089=0.015
max15644.284-15644.145=0.139
mean9200.000
σ0.000
min9200.000
max9200.000
mean1513.000-1672.000=-159.000
σ0.000
min1513.000-1672.000=-159.000
max1513.000-1672.000=-159.000
mean26.679-26.641=0.038
σ0.182-0.219=-0.037
min26.486-26.382=0.104
max26.903-26.871=0.031