Compare commits

Home / Compare 338eb823 .. 0594f117

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-35.611=-1.633
σ0.054-0.054=-0.000
min33.952-35.582=-1.630
max34.131-35.764=-1.633
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.082-0.085=-0.003
σ0.005-0.004=0.002
min0.076-0.082=-0.006
max0.092-0.094=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.319-24.040=-0.721
σ0.003-0.002=0.001
min23.316-24.036=-0.721
max23.327-24.044=-0.717
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.065-0.068=-0.003
σ0.002-0.003=-0.001
min0.064-0.066=-0.002
max0.072-0.075=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.730-1756.495=0.235
σ0.364-0.364=0.000
min1756.158-1755.922=0.236
max1757.316-1757.080=0.236
mean1661.400-1649.200=12.200
σ624.194-639.599=-15.405
min670.000-625.000=45.000
max2650.000-2834.000=-184.000
mean2.375-2.407=-0.032
σ0.121-0.168=-0.047
min2.262-2.285=-0.023
max2.770-2.976=-0.206

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.324-324.767=0.556
σ0.040-0.056=-0.016
min325.253-324.668=0.585
max325.345-324.795=0.550
mean2650.000-2834.000=-184.000
σ0.000
min2650.000-2834.000=-184.000
max2650.000-2834.000=-184.000
mean0.424-0.422=0.002
σ0.005-0.008=-0.002
min0.420-0.418=0.002
max0.431-0.436=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1985.879-1985.329=0.550
σ0.005-0.014=-0.008
min1985.873-1985.306=0.567
max1985.886-1985.341=0.545
mean2650.000-2834.000=-184.000
σ0.000
min2650.000-2834.000=-184.000
max2650.000-2834.000=-184.000
mean2.779-2.663=0.116
σ0.123-0.122=0.001
min2.662-2.568=0.094
max2.949-2.826=0.123
iters=5
new-facts=6402
prior-facts=1
mean4810.736-4810.235=0.501
σ7.701-7.610=0.091
min4807.199-4806.765=0.434
max4824.512-4823.849=0.663
mean2650.000-2834.000=-184.000
σ0.000
min2650.000-2834.000=-184.000
max2650.000-2834.000=-184.000
mean8.575-8.012=0.563
σ0.564-0.282=0.281
min7.678-7.728=-0.050
max9.093-8.450=0.643
iters=5
new-facts=6402
prior-facts=6402
mean4998.188-4997.704=0.483
σ0.171-0.028=0.143
min4997.883-4997.670=0.213
max4998.271-4997.731=0.540
mean2997.800-3041.000=-43.200
σ277.245-283.538=-6.294
min2650.000-2834.000=-184.000
max3366.000-3487.000=-121.000
mean8.671-8.470=0.201
σ0.190-0.124=0.067
min8.466-8.371=0.096
max8.929-8.685=0.244

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.040-0.946=0.094
σ0.262-0.056=0.206
min0.915-0.915=0.001
max1.508-1.045=0.463

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.385-463.217=0.168
σ574.775-574.767=0.009
min175.989-175.830=0.160
max1325.548-1325.367=0.181
mean86.250
σ8.500
min82.000
max99.000
mean2650.000-2834.000=-184.000
σ0.000
min2650.000-2834.000=-184.000
max2650.000-2834.000=-184.000
mean0.545-0.428=0.118
σ0.551-0.295=0.256
min0.268-0.278=-0.010
max1.372-0.871=0.501
policies=20
mean1760.199-1758.618=1.581
σ0.317-0.336=-0.019
min1759.986-1758.400=1.586
max1760.669-1759.118=1.551
mean820.000
σ0.000
min820.000
max820.000
mean2650.000-2834.000=-184.000
σ0.000
min2650.000-2834.000=-184.000
max2650.000-2834.000=-184.000
mean2.693-2.761=-0.068
σ0.012-0.009=0.003
min2.674-2.753=-0.079
max2.701-2.774=-0.072
policies=200
mean17609.471-17593.258=16.213
σ0.534-0.482=0.052
min17609.148-17592.913=16.235
max17610.267-17593.971=16.296
mean8200.000
σ0.000
min8200.000
max8200.000
mean2650.000-2834.000=-184.000
σ0.000
min2650.000-2834.000=-184.000
max2650.000-2834.000=-184.000
mean27.196-27.681=-0.485
σ0.140-0.372=-0.232
min27.040-27.301=-0.261
max27.349-28.143=-0.793