Compare commits

Home / Compare cde2d815 .. 626e802f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=0.001
σ0.055-0.055=0.000
min35.587-35.587=0.000
max35.775-35.774=0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.086-0.084=0.002
σ0.004-0.006=-0.002
min0.081-0.077=0.004
max0.093-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-24.047=-0.000
σ0.003-0.002=0.001
min24.045-24.044=0.001
max24.053-24.051=0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.064-0.069=-0.005
σ0.004-0.003=0.001
min0.061-0.067=-0.006
max0.072-0.076=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.489=0.000
σ0.365-0.365=0.001
min1755.914-1755.915=-0.000
max1757.076-1757.083=-0.007
mean1642.300-1661.400=-19.100
σ643.911-643.030=0.882
min616.000-625.000=-9.000
max2718.000-2782.000=-64.000
mean2.385-2.367=0.018
σ0.113-0.126=-0.014
min2.221-2.251=-0.030
max2.633-2.798=-0.165

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.765-324.762=0.003
σ0.042-0.062=-0.020
min324.691-324.654=0.037
max324.792-324.803=-0.011
mean2718.000-2782.000=-64.000
σ0.000
min2718.000-2782.000=-64.000
max2718.000-2782.000=-64.000
mean0.428-0.436=-0.008
σ0.009-0.010=-0.002
min0.421-0.430=-0.009
max0.442-0.455=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1985.316-1985.326=-0.010
σ0.021-0.011=0.010
min1985.292-1985.306=-0.014
max1985.334-1985.332=0.002
mean2718.000-2782.000=-64.000
σ0.000
min2718.000-2782.000=-64.000
max2718.000-2782.000=-64.000
mean2.631-2.637=-0.007
σ0.102-0.083=0.019
min2.551-2.577=-0.026
max2.761-2.764=-0.004
iters=5
new-facts=6402
prior-facts=1
mean4809.096-4809.095=0.001
σ7.647-7.676=-0.028
min4805.611-4805.642=-0.030
max4822.775-4822.826=-0.051
mean2718.000-2782.000=-64.000
σ0.000
min2718.000-2782.000=-64.000
max2718.000-2782.000=-64.000
mean8.962-8.900=0.062
σ0.362-0.162=0.200
min8.581-8.626=-0.045
max9.521-9.012=0.509
iters=5
new-facts=6402
prior-facts=6402
mean4996.621-4996.617=0.004
σ0.028-0.037=-0.009
min4996.589-4996.557=0.033
max4996.652-4996.658=-0.006
mean2982.200-3047.200=-65.000
σ310.297-328.860=-18.563
min2718.000-2782.000=-64.000
max3430.000-3546.000=-116.000
mean8.458-8.505=-0.047
σ0.049-0.101=-0.052
min8.398-8.427=-0.029
max8.511-8.681=-0.170

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.974-0.927=0.047
σ0.145-0.012=0.133
min0.902-0.919=-0.017
max1.232-0.948=0.284

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.224-463.208=0.016
σ574.795-574.767=0.028
min175.814-175.818=-0.004
max1325.417-1325.359=0.059
mean86.250
σ8.500
min82.000
max99.000
mean2718.000-2782.000=-64.000
σ0.000
min2718.000-2782.000=-64.000
max2718.000-2782.000=-64.000
mean0.531-0.430=0.101
σ0.514-0.296=0.217
min0.273-0.279=-0.006
max1.302-0.875=0.427
policies=20
mean1758.498-1758.526=-0.027
σ0.321-0.336=-0.016
min1758.281-1758.322=-0.041
max1758.973-1759.027=-0.054
mean820.000
σ0.000
min820.000
max820.000
mean2718.000-2782.000=-64.000
σ0.000
min2718.000-2782.000=-64.000
max2718.000-2782.000=-64.000
mean2.694-2.795=-0.101
σ0.016-0.010=0.006
min2.677-2.781=-0.104
max2.711-2.803=-0.092
policies=200
mean17592.157-17592.004=0.153
σ0.533-0.446=0.087
min17591.851-17591.616=0.235
max17592.955-17592.648=0.308
mean8200.000
σ0.000
min8200.000
max8200.000
mean2718.000-2782.000=-64.000
σ0.000
min2718.000-2782.000=-64.000
max2718.000-2782.000=-64.000
mean27.396-27.544=-0.148
σ0.121-0.099=0.021
min27.239-27.395=-0.156
max27.519-27.605=-0.087