Compare commits

Home / Compare f1bfc1b2 .. fd6b16c2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.824-53.823=0.002
σ0.366-0.367=-0.001
min53.682-53.676=0.005
max54.866-54.866=0.000
mean417.600-419.000=-1.400
σ0.843-0.000=0.843
min416.000-419.000=-3.000
max418.000-419.000=-1.000
mean0.140-0.138=0.003
σ0.003-0.004=-0.001
min0.137-0.131=0.006
max0.145-0.143=0.002
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=0.001
σ0.006-0.006=-0.000
min43.201-43.198=0.003
max43.221-43.217=0.004
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.121-0.120=0.001
σ0.004-0.003=0.000
min0.118-0.115=0.003
max0.129-0.124=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.180-1016.178=0.001
σ1.165-1.160=0.005
min1015.610-1015.603=0.008
max1021.057-1021.031=0.026
mean1056.950-1054.050=2.900
σ315.483-312.077=3.406
min589.000-562.000=27.000
max1678.000-1520.000=158.000
mean1.557-1.552=0.005
σ0.090-0.066=0.023
min1.434-1.481=-0.046
max1.820-1.699=0.121

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.383-301.288=0.095
σ0.247-0.218=0.029
min301.225-301.073=0.152
max302.067-301.853=0.214
mean1952.000-2042.000=-90.000
σ0.000
min1952.000-2042.000=-90.000
max1952.000-2042.000=-90.000
mean0.556-0.557=-0.001
σ0.037-0.027=0.010
min0.498-0.511=-0.014
max0.602-0.577=0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.689-300.701=-0.011
σ0.032-0.021=0.012
min300.633-300.671=-0.038
max300.708-300.728=-0.020
mean1678.000-1520.000=158.000
σ0.000
min1678.000-1520.000=158.000
max1678.000-1520.000=158.000
mean0.395-0.395=-0.000
σ0.007-0.008=-0.001
min0.387-0.387=0.001
max0.405-0.406=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1322.864-1322.854=0.010
σ0.103-0.090=0.013
min1322.808-1322.808=-0.000
max1323.048-1323.014=0.033
mean1678.000-1520.000=158.000
σ0.000
min1678.000-1520.000=158.000
max1678.000-1520.000=158.000
mean1.967-1.925=0.043
σ0.133-0.116=0.017
min1.816-1.822=-0.006
max2.176-2.097=0.079
iters=5
new-facts=6402
prior-facts=1
mean1561.309-1561.328=-0.019
σ6.871-6.872=-0.001
min1557.987-1558.045=-0.058
max1573.593-1573.617=-0.024
mean1678.000-1520.000=158.000
σ0.000
min1678.000-1520.000=158.000
max1678.000-1520.000=158.000
mean2.306-2.361=-0.055
σ0.275-0.327=-0.052
min2.004-2.048=-0.044
max2.622-2.718=-0.096
iters=5
new-facts=6402
prior-facts=6402
mean1890.796-1890.798=-0.002
σ0.013-0.020=-0.007
min1890.781-1890.784=-0.003
max1890.816-1890.825=-0.009
mean1792.800-1740.600=52.200
σ103.967-213.574=-109.607
min1678.000-1520.000=158.000
max1952.000-2042.000=-90.000
mean2.897-2.908=-0.011
σ0.130-0.050=0.080
min2.811-2.866=-0.055
max3.122-2.986=0.135

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.105-1.565=-0.460
σ0.338-0.313=0.025
min0.912-1.221=-0.308
max1.701-1.859=-0.158

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.320-443.312=0.008
σ573.953-573.946=0.008
min156.336-156.336=0.000
max1304.250-1304.231=0.020
mean96.250
σ8.500
min92.000
max109.000
mean1678.000-1520.000=158.000
σ0.000
min1678.000-1520.000=158.000
max1678.000-1520.000=158.000
mean0.522-0.543=-0.021
σ0.525-0.559=-0.033
min0.258-0.262=-0.003
max1.310-1.381=-0.071
policies=20
mean1563.637-1563.625=0.012
σ0.325-0.339=-0.014
min1563.468-1563.419=0.049
max1564.125-1564.132=-0.007
mean920.000
σ0.000
min920.000
max920.000
mean1678.000-1520.000=158.000
σ0.000
min1678.000-1520.000=158.000
max1678.000-1520.000=158.000
mean2.626-2.624=0.002
σ0.005-0.015=-0.010
min2.620-2.609=0.011
max2.632-2.645=-0.013
policies=200
mean15644.070-15644.063=0.007
σ0.059-0.075=-0.017
min15643.984-15643.983=0.001
max15644.109-15644.146=-0.037
mean9200.000
σ0.000
min9200.000
max9200.000
mean1678.000-1520.000=158.000
σ0.000
min1678.000-1520.000=158.000
max1678.000-1520.000=158.000
mean26.540-26.531=0.009
σ0.217-0.220=-0.003
min26.261-26.312=-0.051
max26.768-26.792=-0.024