Compare commits

Home / Compare c1d87c7f .. 932dddf5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-73.046=-37.428
σ0.055-0.049=0.007
min35.587-73.018=-37.431
max35.775-73.184=-37.409
mean414.000-413.800=0.200
σ0.000-0.422=-0.422
min414.000-413.000=1.000
max414.000
mean0.086-0.161=-0.075
σ0.004-0.003=0.001
min0.081-0.157=-0.076
max0.093-0.167=-0.074
cache=y
dps=1
iters=10
policies=100
mean24.047-23.740=0.307
σ0.003-0.002=0.000
min24.045-23.737=0.308
max24.053-23.744=0.309
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.064=-0.000
σ0.004-0.004=0.000
min0.061-0.060=0.001
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1758.771=-2.282
σ0.365-0.361=0.005
min1755.914-1758.197=-2.283
max1757.076-1759.353=-2.277
mean1642.300-1660.050=-17.750
σ643.911-634.986=8.925
min616.000-617.000=-1.000
max2718.000-2899.000=-181.000
mean2.385-2.816=-0.431
σ0.113-0.194=-0.081
min2.221-2.309=-0.088
max2.633-3.132=-0.499

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.765-324.000=0.765
σ0.042-0.055=-0.013
min324.691-323.902=0.789
max324.792-324.033=0.759
mean2718.000-2899.000=-181.000
σ0.000
min2718.000-2899.000=-181.000
max2718.000-2899.000=-181.000
mean0.428-0.430=-0.001
σ0.009-0.007=0.002
min0.421-0.424=-0.003
max0.442-0.439=0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.316-1984.578=0.738
σ0.021-0.015=0.005
min1985.292-1984.554=0.738
max1985.334-1984.592=0.742
mean2718.000-2899.000=-181.000
σ0.000
min2718.000-2899.000=-181.000
max2718.000-2899.000=-181.000
mean2.631-2.567=0.064
σ0.102-0.072=0.030
min2.551-2.496=0.055
max2.761-2.685=0.075
iters=5
new-facts=6402
prior-facts=1
mean4809.096-4808.224=0.872
σ7.647-7.814=-0.167
min4805.611-4804.642=0.970
max4822.775-4822.201=0.574
mean2718.000-2899.000=-181.000
σ0.000
min2718.000-2899.000=-181.000
max2718.000-2899.000=-181.000
mean8.962-8.967=-0.005
σ0.362-0.213=0.150
min8.581-8.720=-0.139
max9.521-9.303=0.218
iters=5
new-facts=6402
prior-facts=6402
mean4996.621-4995.788=0.833
σ0.028-0.028=-0.000
min4996.589-4995.759=0.831
max4996.652-4995.821=0.831
mean2982.200-3074.000=-91.800
σ310.297-240.269=70.028
min2718.000-2899.000=-181.000
max3430.000-3437.000=-7.000
mean8.458-8.507=-0.048
σ0.049-0.084=-0.036
min8.398-8.455=-0.057
max8.511-8.654=-0.144

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.974-1.127=-0.153
σ0.145-0.246=-0.101
min0.902-0.921=-0.019
max1.232-1.506=-0.274

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.224-468.330=-5.105
σ574.795-574.242=0.554
min175.814-181.203=-5.388
max1325.417-1329.692=-4.275
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2718.000-2899.000=-181.000
σ0.000
min2718.000-2899.000=-181.000
max2718.000-2899.000=-181.000
mean0.531-0.446=0.085
σ0.514-0.304=0.209
min0.273-0.289=-0.016
max1.302-0.902=0.400
policies=20
mean1758.498-1812.356=-53.858
σ0.321-0.390=-0.070
min1758.281-1812.067=-53.785
max1758.973-1812.922=-53.949
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2718.000-2899.000=-181.000
σ0.000
min2718.000-2899.000=-181.000
max2718.000-2899.000=-181.000
mean2.694-2.894=-0.200
σ0.016-0.013=0.003
min2.677-2.883=-0.206
max2.711-2.912=-0.202
policies=200
mean17592.157-18129.828=-537.671
σ0.533-0.660=-0.127
min17591.851-18128.966=-537.115
max17592.955-18130.345=-537.390
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2718.000-2899.000=-181.000
σ0.000
min2718.000-2899.000=-181.000
max2718.000-2899.000=-181.000
mean27.396-28.810=-1.414
σ0.121-0.355=-0.234
min27.239-28.326=-1.087
max27.519-29.114=-1.596