Compare commits

Home / Compare 8f58d771 .. 3c4e494d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.837-53.822=0.014
σ0.369-0.367=0.001
min53.694-53.683=0.011
max54.885-54.867=0.018
mean421.000-417.000=4.000
σ0.000
min421.000-417.000=4.000
max421.000-417.000=4.000
mean0.140-0.137=0.004
σ0.004-0.005=-0.001
min0.135-0.129=0.006
max0.146-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=-0.000
σ0.005-0.006=-0.001
min43.199-43.198=0.002
max43.213-43.215=-0.002
mean421.000-417.000=4.000
σ0.000
min421.000-417.000=4.000
max421.000-417.000=4.000
mean0.120-0.118=0.002
σ0.005-0.004=0.001
min0.114-0.113=0.001
max0.129-0.125=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.207-1016.178=0.028
σ1.153-1.177=-0.024
min1015.633-1015.634=-0.000
max1021.025-1021.104=-0.079
mean1047.000-1049.350=-2.350
σ310.478-311.883=-1.406
min593.000-557.000=36.000
max1634.000-1515.000=119.000
mean1.533-1.554=-0.021
σ0.068-0.060=0.008
min1.459-1.488=-0.030
max1.760-1.672=0.088

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.332-301.359=-0.027
σ0.248-0.255=-0.006
min301.115-301.185=-0.070
max301.962-302.045=-0.083
mean1946.000-2037.000=-91.000
σ0.000
min1946.000-2037.000=-91.000
max1946.000-2037.000=-91.000
mean0.554-0.553=0.001
σ0.030-0.031=-0.001
min0.501-0.505=-0.004
max0.594-0.587=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.467-300.704=0.763
σ0.064-0.023=0.041
min301.362-300.680=0.682
max301.525-300.735=0.790
mean1634.000-1515.000=119.000
σ0.000
min1634.000-1515.000=119.000
max1634.000-1515.000=119.000
mean0.396-0.396=0.000
σ0.004-0.007=-0.003
min0.393-0.388=0.005
max0.402-0.403=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1324.055-1322.862=1.194
σ0.111-0.086=0.025
min1323.915-1322.817=1.098
max1324.206-1323.015=1.191
mean1634.000-1515.000=119.000
σ0.000
min1634.000-1515.000=119.000
max1634.000-1515.000=119.000
mean1.970-1.885=0.084
σ0.139-0.062=0.077
min1.853-1.823=0.029
max2.209-1.951=0.258
iters=5
new-facts=6402
prior-facts=1
mean1562.100-1561.321=0.778
σ6.929-6.884=0.045
min1558.728-1558.036=0.692
max1574.488-1573.632=0.856
mean1634.000-1515.000=119.000
σ0.000
min1634.000-1515.000=119.000
max1634.000-1515.000=119.000
mean2.395-2.365=0.029
σ0.362-0.361=0.002
min2.096-2.044=0.052
max2.890-2.788=0.102
iters=5
new-facts=6402
prior-facts=6402
mean1891.978-1890.796=1.182
σ0.089-0.030=0.060
min1891.821-1890.761=1.059
max1892.041-1890.838=1.203
mean1800.800-1733.400=67.400
σ118.755-214.426=-95.671
min1634.000-1515.000=119.000
max1946.000-2037.000=-91.000
mean2.988-3.097=-0.109
σ0.163-0.382=-0.219
min2.846-2.868=-0.022
max3.240-3.753=-0.513

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.171-1.471=-0.300
σ0.350-0.229=0.121
min0.919-1.217=-0.298
max1.760-1.753=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.488-443.040=0.448
σ574.248-573.408=0.841
min156.361-156.333=0.027
max1304.860-1303.151=1.709
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1515.000=119.000
σ0.000
min1634.000-1515.000=119.000
max1634.000-1515.000=119.000
mean0.553-0.540=0.013
σ0.567-0.561=0.006
min0.264-0.256=0.008
max1.404-1.382=0.022
policies=20
mean1563.931-1563.618=0.313
σ0.338-0.323=0.016
min1563.752-1563.413=0.339
max1564.439-1564.100=0.339
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1515.000=119.000
σ0.000
min1634.000-1515.000=119.000
max1634.000-1515.000=119.000
mean2.639-2.587=0.053
σ0.014-0.015=-0.001
min2.625-2.566=0.059
max2.657-2.601=0.056
policies=200
mean15646.873-15644.108=2.765
σ0.090-0.027=0.063
min15646.744-15644.084=2.660
max15646.945-15644.140=2.805
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1515.000=119.000
σ0.000
min1634.000-1515.000=119.000
max1634.000-1515.000=119.000
mean26.579-26.459=0.121
σ0.156-0.100=0.056
min26.443-26.377=0.066
max26.748-26.594=0.153