Compare commits

Home / Compare 7a36b2bd .. 29dda2a2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.049-53.823=0.226
σ0.370-0.368=0.002
min53.912-53.677=0.234
max55.100-54.868=0.232
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.139-0.140=-0.001
σ0.003-0.004=-0.001
min0.136-0.137=-0.001
max0.144-0.148=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.341-43.208=0.133
σ0.007-0.007=0.000
min43.331-43.198=0.133
max43.357-43.218=0.139
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.120-0.121=-0.001
σ0.005-0.004=0.000
min0.115-0.115=-0.000
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.195-1016.182=1.013
σ1.229-1.146=0.083
min1016.664-1015.604=1.061
max1022.356-1020.967=1.389
mean1057.050-1049.950=7.100
σ316.708-311.865=4.843
min559.000-558.000=1.000
max1516.000
mean1.571-1.542=0.029
σ0.142-0.047=0.094
min1.473-1.481=-0.008
max2.101-1.632=0.469

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.922-301.362=0.560
σ0.256-0.203=0.052
min301.760-301.088=0.672
max302.626-301.848=0.778
mean2097.000-1951.000=146.000
σ0.000
min2097.000-1951.000=146.000
max2097.000-1951.000=146.000
mean0.566-0.561=0.005
σ0.042-0.031=0.011
min0.501-0.509=-0.008
max0.626-0.594=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.778-300.703=3.075
σ0.059-0.020=0.040
min303.688-300.677=3.011
max303.841-300.728=3.113
mean1516.000
σ0.000
min1516.000
max1516.000
mean0.395-0.398=-0.003
σ0.009-0.007=0.001
min0.389-0.390=-0.001
max0.410-0.408=0.002
iters=5
new-facts=1
prior-facts=6402
mean1326.333-1322.877=3.456
σ0.107-0.096=0.010
min1326.198-1322.811=3.387
max1326.462-1323.036=3.426
mean1516.000
σ0.000
min1516.000
max1516.000
mean1.935-1.916=0.019
σ0.095-0.075=0.021
min1.830-1.833=-0.003
max2.039-2.029=0.010
iters=5
new-facts=6402
prior-facts=1
mean1564.374-1561.305=3.070
σ6.898-6.891=0.008
min1561.084-1557.971=3.113
max1576.709-1573.625=3.084
mean1516.000
σ0.000
min1516.000
max1516.000
mean2.306-2.251=0.055
σ0.280-0.282=-0.003
min2.026-2.080=-0.054
max2.679-2.747=-0.068
iters=5
new-facts=6402
prior-facts=6402
mean1894.273-1890.802=3.471
σ0.061-0.032=0.029
min1894.169-1890.784=3.385
max1894.319-1890.859=3.460
mean1751.400-1763.600=-12.200
σ236.757-154.244=82.513
min1516.000-1529.000=-13.000
max2097.000-1951.000=146.000
mean2.953-3.012=-0.059
σ0.123-0.179=-0.057
min2.868-2.870=-0.002
max3.156-3.310=-0.154

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.550-1.478=0.072
σ0.306-0.281=0.025
min1.187-1.199=-0.012
max1.858-1.783=0.075

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.329-443.037=5.292
σ581.790-573.404=8.386
min157.430-156.332=1.098
max1321.014-1303.143=17.871
mean96.250
σ8.500
min92.000
max109.000
mean1516.000
σ0.000
min1516.000
max1516.000
mean0.547-0.542=0.005
σ0.561-0.545=0.016
min0.261-0.262=-0.001
max1.388-1.360=0.029
policies=20
mean1574.573-1563.599=10.974
σ0.342-0.329=0.013
min1574.346-1563.395=10.951
max1575.082-1564.090=10.992
mean920.000
σ0.000
min920.000
max920.000
mean1516.000
σ0.000
min1516.000
max1516.000
mean2.620-2.605=0.015
σ0.019-0.018=0.001
min2.600-2.589=0.011
max2.641-2.628=0.013
policies=200
mean15754.001-15643.953=110.047
σ0.065-0.078=-0.013
min15753.949-15643.871=110.078
max15754.093-15644.055=110.038
mean9200.000
σ0.000
min9200.000
max9200.000
mean1516.000
σ0.000
min1516.000
max1516.000
mean26.649-26.461=0.188
σ0.303-0.191=0.112
min26.472-26.268=0.204
max27.102-26.682=0.420