Compare commits

Home / Compare 43c308d0 .. 1a620ceb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.000
σ0.055-0.056=-0.001
min35.591-35.588=0.003
max35.772-35.775=-0.002
mean413.900-416.000=-2.100
σ0.316-0.000=0.316
min413.000-416.000=-3.000
max414.000-416.000=-2.000
mean0.085-0.083=0.002
σ0.003-0.006=-0.003
min0.082-0.076=0.006
max0.090-0.094=-0.005
cache=y
dps=1
iters=10
policies=100
mean24.046-24.048=-0.001
σ0.003-0.004=-0.000
min24.042-24.042=0.000
max24.053-24.053=-0.000
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.067-0.066=0.001
σ0.001-0.003=-0.002
min0.066-0.061=0.005
max0.068-0.067=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.489=-0.001
σ0.364-0.364=0.000
min1755.916-1755.916=0.000
max1757.074-1757.082=-0.008
mean1658.700-1650.700=8.000
σ638.716-641.545=-2.829
min628.000-634.000=-6.000
max2753.000-2834.000=-81.000
mean2.347-2.371=-0.024
σ0.089-0.144=-0.055
min2.244-2.265=-0.020
max2.540-2.903=-0.363

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.775-324.764=0.011
σ0.031-0.046=-0.015
min324.720-324.683=0.037
max324.792-324.794=-0.001
mean2753.000-2834.000=-81.000
σ0.000
min2753.000-2834.000=-81.000
max2753.000-2834.000=-81.000
mean0.433-0.422=0.011
σ0.019-0.001=0.018
min0.421-0.421=0.001
max0.466-0.424=0.043
iters=5
new-facts=1
prior-facts=6402
mean1985.323-1985.327=-0.004
σ0.008-0.004=0.004
min1985.313-1985.322=-0.009
max1985.333-1985.330=0.003
mean2753.000-2834.000=-81.000
σ0.000
min2753.000-2834.000=-81.000
max2753.000-2834.000=-81.000
mean2.625-2.691=-0.066
σ0.126-0.176=-0.050
min2.475-2.543=-0.068
max2.776-2.905=-0.129
iters=5
new-facts=6402
prior-facts=1
mean4808.869-4809.078=-0.209
σ7.823-7.694=0.129
min4804.649-4805.584=-0.935
max4822.844-4822.842=0.001
mean2753.000-2834.000=-81.000
σ0.000
min2753.000-2834.000=-81.000
max2753.000-2834.000=-81.000
mean8.557-8.797=-0.240
σ0.533-0.144=0.389
min7.885-8.591=-0.707
max9.099-8.944=0.155
iters=5
new-facts=6402
prior-facts=6402
mean4996.620-4996.624=-0.004
σ0.022-0.021=0.001
min4996.599-4996.596=0.003
max4996.648-4996.647=0.002
mean3035.400-3035.000=0.400
σ338.637-207.434=131.203
min2753.000-2834.000=-81.000
max3537.000-3327.000=210.000
mean8.536-8.692=-0.156
σ0.137-0.191=-0.054
min8.418-8.476=-0.058
max8.742-8.994=-0.252

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.983-1.009=-0.026
σ0.138-0.134=0.004
min0.916-0.921=-0.005
max1.230-1.226=0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.214-463.214=-0.001
σ574.772-574.770=0.002
min175.818-175.819=-0.002
max1325.371-1325.369=0.003
mean86.250
σ8.500
min82.000
max99.000
mean2753.000-2834.000=-81.000
σ0.000
min2753.000-2834.000=-81.000
max2753.000-2834.000=-81.000
mean0.429-0.434=-0.005
σ0.293-0.307=-0.014
min0.278-0.278=-0.000
max0.869-0.895=-0.025
policies=20
mean1758.507-1758.503=0.004
σ0.351-0.339=0.012
min1758.269-1758.274=-0.005
max1759.027-1759.006=0.021
mean820.000
σ0.000
min820.000
max820.000
mean2753.000-2834.000=-81.000
σ0.000
min2753.000-2834.000=-81.000
max2753.000-2834.000=-81.000
mean2.823-2.786=0.038
σ0.065-0.004=0.061
min2.779-2.780=-0.002
max2.918-2.791=0.127
policies=200
mean17592.095-17592.146=-0.051
σ0.552-0.515=0.038
min17591.645-17591.826=-0.181
max17592.901-17592.910=-0.010
mean8200.000
σ0.000
min8200.000
max8200.000
mean2753.000-2834.000=-81.000
σ0.000
min2753.000-2834.000=-81.000
max2753.000-2834.000=-81.000
mean27.399-27.868=-0.469
σ0.098-0.344=-0.246
min27.310-27.550=-0.240
max27.491-28.272=-0.781