Compare commits

Home / Compare 906b7cfe .. dacf3eab

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.972-35.959=0.013
σ0.105-0.103=0.002
min35.920-35.920=-0.000
max36.268-36.251=0.016
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.077-0.077=-0.000
σ0.004-0.004=-0.000
min0.074-0.074=0.000
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.207-26.203=0.004
σ0.002-0.004=-0.002
min26.202-26.195=0.007
max26.210-26.209=0.001
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.061-0.061=-0.000
σ0.002-0.003=-0.000
min0.059-0.059=-0.000
max0.067-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.365-1757.659=0.706
σ0.369-0.371=-0.002
min1757.788-1757.081=0.707
max1758.945-1758.253=0.692
mean1656.850-1642.700=14.150
σ620.620-634.294=-13.674
min686.000-625.000=61.000
max2744.000-2827.000=-83.000
mean2.361-2.374=-0.014
σ0.112-0.197=-0.086
min2.195-2.251=-0.056
max2.597-3.183=-0.586

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.512-280.099=-0.586
σ0.008-0.007=0.001
min279.500-280.092=-0.592
max279.521-280.110=-0.589
mean2744.000-2827.000=-83.000
σ0.000
min2744.000-2827.000=-83.000
max2744.000-2827.000=-83.000
mean0.405-0.417=-0.012
σ0.005-0.008=-0.003
min0.400-0.409=-0.010
max0.413-0.427=-0.014
iters=5
new-facts=1
prior-facts=6402
mean2178.438-2270.150=-91.712
σ0.012-0.015=-0.004
min2178.426-2270.125=-91.699
max2178.455-2270.166=-91.711
mean2744.000-2827.000=-83.000
σ0.000
min2744.000-2827.000=-83.000
max2744.000-2827.000=-83.000
mean3.366-3.571=-0.205
σ0.211-0.215=-0.004
min3.194-3.307=-0.113
max3.728-3.820=-0.092
iters=5
new-facts=6402
prior-facts=1
mean5056.359-5139.176=-82.816
σ0.980-0.981=-0.001
min5055.804-5138.534=-82.731
max5058.104-5140.916=-82.812
mean2744.000-2827.000=-83.000
σ0.000
min2744.000-2827.000=-83.000
max2744.000-2827.000=-83.000
mean8.945-8.795=0.150
σ0.600-0.804=-0.204
min8.067-8.072=-0.006
max9.559-9.712=-0.153
iters=5
new-facts=6402
prior-facts=6402
mean5193.736-5277.144=-83.407
σ0.095-0.195=-0.100
min5193.622-5276.823=-83.201
max5193.854-5277.323=-83.468
mean3220.400-3501.600=-281.200
σ467.854-522.500=-54.646
min2744.000-2827.000=-83.000
max3892.000-4007.000=-115.000
mean8.717-10.172=-1.455
σ0.204-0.203=0.001
min8.540-9.873=-1.333
max9.070-10.382=-1.312

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.995-1.064=-0.069
σ0.067-0.284=-0.217
min0.938-0.927=0.011
max1.078-1.571=-0.493

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.478-464.171=1.307
σ572.656-572.660=-0.003
min179.146-177.827=1.319
max1324.462-1323.160=1.302
mean79.500-81.500=-2.000
σ7.000
min76.000-78.000=-2.000
max90.000-92.000=-2.000
mean2744.000-2827.000=-83.000
σ0.000
min2744.000-2827.000=-83.000
max2744.000-2827.000=-83.000
mean0.483-0.436=0.047
σ0.405-0.297=0.109
min0.278-0.286=-0.007
max1.091-0.881=0.210
policies=20
mean1791.704-1778.646=13.058
σ0.330-0.367=-0.037
min1791.517-1778.422=13.095
max1792.197-1779.191=13.006
mean760.000-780.000=-20.000
σ0.000
min760.000-780.000=-20.000
max760.000-780.000=-20.000
mean2744.000-2827.000=-83.000
σ0.000
min2744.000-2827.000=-83.000
max2744.000-2827.000=-83.000
mean2.801-2.841=-0.040
σ0.016-0.013=0.003
min2.782-2.822=-0.040
max2.819-2.850=-0.031
policies=200
mean17923.357-17793.156=130.201
σ0.520-0.484=0.036
min17923.024-17792.812=130.211
max17924.120-17793.873=130.247
mean7600.000-7800.000=-200.000
σ0.000
min7600.000-7800.000=-200.000
max7600.000-7800.000=-200.000
mean2744.000-2827.000=-83.000
σ0.000
min2744.000-2827.000=-83.000
max2744.000-2827.000=-83.000
mean28.124-28.214=-0.090
σ0.061-0.383=-0.322
min28.072-27.825=0.247
max28.211-28.650=-0.438