Compare commits

Home / Compare 1bbb5ee4 .. b63770fb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=-0.000
σ0.049-0.049=-0.000
min33.953-33.950=0.003
max34.114-34.114=0.000
mean415.700-416.000=-0.300
σ0.483-0.000=0.483
min415.000-416.000=-1.000
max416.000
mean0.084-0.085=-0.001
σ0.003-0.003=-0.000
min0.082-0.083=-0.001
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.004-0.003=0.001
min23.310-23.314=-0.003
max23.323-23.321=0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.001
min0.061-0.064=-0.003
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.362-1757.364=-0.003
σ0.363-0.364=-0.002
min1756.787-1756.787=-0.000
max1757.938-1757.956=-0.018
mean1665.100-1651.050=14.050
σ622.998-630.695=-7.696
min689.000-638.000=51.000
max2758.000-2837.000=-79.000
mean2.370-2.371=-0.001
σ0.141-0.097=0.044
min2.231-2.274=-0.043
max2.853-2.679=0.174

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.502-326.505=-0.004
σ0.058-0.058=0.000
min326.398-326.402=-0.004
max326.534-326.537=-0.003
mean2758.000-2837.000=-79.000
σ0.000
min2758.000-2837.000=-79.000
max2758.000-2837.000=-79.000
mean0.424-0.430=-0.006
σ0.001-0.007=-0.006
min0.423-0.424=-0.001
max0.425-0.442=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1988.672-1988.677=-0.005
σ0.017-0.007=0.011
min1988.645-1988.667=-0.023
max1988.688-1988.684=0.004
mean2758.000-2837.000=-79.000
σ0.000
min2758.000-2837.000=-79.000
max2758.000-2837.000=-79.000
mean2.649-2.759=-0.110
σ0.106-0.191=-0.085
min2.479-2.651=-0.172
max2.768-3.098=-0.329
iters=5
new-facts=6402
prior-facts=1
mean4813.538-4813.547=-0.009
σ7.674-7.739=-0.065
min4810.050-4809.973=0.077
max4827.265-4827.390=-0.125
mean2758.000-2837.000=-79.000
σ0.000
min2758.000-2837.000=-79.000
max2758.000-2837.000=-79.000
mean8.410-8.561=-0.151
σ0.389-0.489=-0.101
min7.980-7.942=0.039
max8.787-9.312=-0.525
iters=5
new-facts=6402
prior-facts=6402
mean5001.081-5001.070=0.011
σ0.038-0.022=0.015
min5001.043-5001.045=-0.002
max5001.137-5001.094=0.043
mean3013.400-3072.400=-59.000
σ237.794-312.470=-74.677
min2758.000-2837.000=-79.000
max3335.000-3558.000=-223.000
mean9.968-9.721=0.247
σ0.301-0.233=0.068
min9.762-9.375=0.387
max10.499-10.004=0.495

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.006-0.970=0.036
σ0.135-0.049=0.086
min0.914-0.940=-0.026
max1.225-1.057=0.168

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.506-464.506=-0.000
σ574.772-574.773=-0.001
min177.108-177.106=0.003
max1326.664-1326.666=-0.002
mean88.250
σ8.500
min84.000
max101.000
mean2758.000-2837.000=-79.000
σ0.000
min2758.000-2837.000=-79.000
max2758.000-2837.000=-79.000
mean0.440-0.440=-0.001
σ0.308-0.311=-0.004
min0.280-0.281=-0.001
max0.901-0.908=-0.006
policies=20
mean1771.438-1771.412=0.026
σ0.381-0.359=0.022
min1771.166-1771.157=0.008
max1772.001-1771.940=0.061
mean840.000
σ0.000
min840.000
max840.000
mean2758.000-2837.000=-79.000
σ0.000
min2758.000-2837.000=-79.000
max2758.000-2837.000=-79.000
mean2.839-2.825=0.013
σ0.063-0.019=0.044
min2.805-2.806=-0.001
max2.933-2.847=0.086
policies=200
mean17720.979-17721.057=-0.078
σ0.499-0.383=0.116
min17720.595-17720.749=-0.154
max17721.712-17721.606=0.106
mean8400.000
σ0.000
min8400.000
max8400.000
mean2758.000-2837.000=-79.000
σ0.000
min2758.000-2837.000=-79.000
max2758.000-2837.000=-79.000
mean27.606-28.115=-0.510
σ0.299-0.411=-0.112
min27.393-27.757=-0.363
max28.036-28.613=-0.578