Compare commits

Home / Compare ed536a9b .. f3f5e221

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.619-35.618=0.001
σ0.052-0.055=-0.003
min35.595-35.588=0.007
max35.765-35.773=-0.008
mean414.900-415.000=-0.100
σ0.316-0.000=0.316
min414.000-415.000=-1.000
max415.000
mean0.082-0.085=-0.003
σ0.005-0.003=0.002
min0.076-0.082=-0.006
max0.088-0.091=-0.003
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.001
σ0.002-0.003=-0.001
min24.044-24.042=0.002
max24.051-24.051=-0.000
mean415.000
σ0.000
min415.000
max415.000
mean0.067-0.067=0.000
σ0.001-0.001=0.000
min0.066-0.065=0.000
max0.068-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.492-1756.492=0.000
σ0.365-0.365=0.001
min1755.917-1755.916=0.001
max1757.081-1757.086=-0.005
mean1645.950-1653.600=-7.650
σ645.280-628.843=16.437
min623.000
max2724.000-2703.000=21.000
mean2.377-2.348=0.029
σ0.127-0.105=0.022
min2.224-2.187=0.038
max2.650-2.649=0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.768-324.757=0.011
σ0.041-0.058=-0.017
min324.695-324.653=0.042
max324.796-324.790=0.006
mean2724.000-2703.000=21.000
σ0.000
min2724.000-2703.000=21.000
max2724.000-2703.000=21.000
mean0.423-0.438=-0.015
σ0.002-0.015=-0.013
min0.420-0.420=0.000
max0.424-0.452=-0.028
iters=5
new-facts=1
prior-facts=6402
mean1985.306-1985.315=-0.009
σ0.026-0.013=0.013
min1985.272-1985.304=-0.032
max1985.334-1985.330=0.004
mean2724.000-2703.000=21.000
σ0.000
min2724.000-2703.000=21.000
max2724.000-2703.000=21.000
mean2.668-2.696=-0.028
σ0.126-0.121=0.005
min2.575-2.605=-0.030
max2.837-2.868=-0.031
iters=5
new-facts=6402
prior-facts=1
mean4808.882-4809.110=-0.228
σ7.475-7.679=-0.204
min4805.060-4805.617=-0.557
max4822.243-4822.847=-0.604
mean2724.000-2703.000=21.000
σ0.000
min2724.000-2703.000=21.000
max2724.000-2703.000=21.000
mean8.655-8.829=-0.174
σ0.525-0.327=0.198
min7.927-8.287=-0.361
max9.401-9.091=0.310
iters=5
new-facts=6402
prior-facts=6402
mean4996.628-4996.626=0.002
σ0.025-0.027=-0.002
min4996.601-4996.592=0.009
max4996.656-4996.650=0.005
mean3000.000-3008.600=-8.600
σ326.277-353.964=-27.688
min2724.000-2703.000=21.000
max3488.000-3525.000=-37.000
mean8.508-8.536=-0.028
σ0.117-0.080=0.037
min8.427-8.488=-0.061
max8.712-8.679=0.033

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.950-0.971=-0.022
σ0.058-0.064=-0.006
min0.904-0.917=-0.013
max1.050-1.051=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.214-463.208=0.006
σ574.776-574.773=0.003
min175.814-175.817=-0.003
max1325.378-1325.367=0.011
mean86.250
σ8.500
min82.000
max99.000
mean2724.000-2703.000=21.000
σ0.000
min2724.000-2703.000=21.000
max2724.000-2703.000=21.000
mean0.529-0.543=-0.013
σ0.508-0.532=-0.024
min0.273-0.275=-0.002
max1.291-1.340=-0.049
policies=20
mean1758.492-1758.503=-0.011
σ0.323-0.327=-0.005
min1758.292-1758.295=-0.003
max1758.971-1758.990=-0.018
mean820.000
σ0.000
min820.000
max820.000
mean2724.000-2703.000=21.000
σ0.000
min2724.000-2703.000=21.000
max2724.000-2703.000=21.000
mean2.711-2.718=-0.008
σ0.005-0.017=-0.012
min2.704-2.698=0.005
max2.716-2.739=-0.023
policies=200
mean17592.146-17592.070=0.076
σ0.475-0.347=0.128
min17591.854-17591.874=-0.020
max17592.856-17592.590=0.266
mean8200.000
σ0.000
min8200.000
max8200.000
mean2724.000-2703.000=21.000
σ0.000
min2724.000-2703.000=21.000
max2724.000-2703.000=21.000
mean27.412-27.386=0.026
σ0.123-0.106=0.017
min27.252-27.243=0.008
max27.546-27.484=0.063