Compare commits

Home / Compare 27610d98 .. d93c2fab

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=-0.000
σ0.049-0.050=-0.000
min31.002-31.001=0.000
max31.176-31.178=-0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.073-0.077=-0.003
σ0.004-0.004=-0.000
min0.070-0.072=-0.001
max0.081-0.084=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.003-0.002=0.001
min21.141-21.140=0.001
max21.148-21.146=0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.066-0.065=0.001
σ0.003-0.002=0.001
min0.063-0.063=0.000
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.413=-0.001
σ0.360-0.362=-0.002
min1750.853-1750.840=0.013
max1751.976-1751.993=-0.017
mean1660.600-1663.550=-2.950
σ621.270-623.994=-2.724
min639.000-645.000=-6.000
max2505.000-2513.000=-8.000
mean2.831-2.822=0.009
σ0.191-0.146=0.045
min2.293-2.263=0.030
max3.210-2.955=0.255

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.397-273.401=-0.004
σ0.018-0.012=0.006
min273.367-273.388=-0.021
max273.412-273.415=-0.002
mean2505.000-2513.000=-8.000
σ0.000
min2505.000-2513.000=-8.000
max2505.000-2513.000=-8.000
mean0.384-0.385=-0.001
σ0.009-0.009=-0.000
min0.377-0.377=-0.000
max0.394-0.395=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.834-1933.835=-0.000
σ0.004-0.009=-0.005
min1933.831-1933.824=0.007
max1933.841-1933.845=-0.004
mean2505.000-2513.000=-8.000
σ0.000
min2505.000-2513.000=-8.000
max2505.000-2513.000=-8.000
mean3.030-3.061=-0.032
σ0.109-0.091=0.019
min2.876-2.986=-0.110
max3.165-3.197=-0.032
iters=5
new-facts=6402
prior-facts=1
mean4754.292-4754.350=-0.058
σ0.879-0.868=0.011
min4753.614-4753.732=-0.118
max4755.835-4755.882=-0.047
mean2505.000-2513.000=-8.000
σ0.000
min2505.000-2513.000=-8.000
max2505.000-2513.000=-8.000
mean8.069-8.598=-0.529
σ0.382-0.438=-0.057
min7.740-8.103=-0.363
max8.707-9.183=-0.475
iters=5
new-facts=6402
prior-facts=6402
mean4944.727-4944.791=-0.064
σ0.199-0.089=0.110
min4944.391-4944.710=-0.318
max4944.876-4944.888=-0.012
mean2962.200-2996.800=-34.600
σ412.198-281.468=130.730
min2505.000-2604.000=-99.000
max3523.000-3359.000=164.000
mean8.625-8.554=0.070
σ0.461-0.175=0.286
min8.393-8.410=-0.017
max9.449-8.816=0.633

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.732-1.560=0.171
σ0.066-0.180=-0.113
min1.639-1.399=0.241
max1.801-1.835=-0.034

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.333-463.338=-0.005
σ572.193-572.200=-0.007
min177.235-177.233=0.002
max1321.623-1321.638=-0.015
mean79.750
σ7.500
min76.000
max91.000
mean2505.000-2513.000=-8.000
σ0.000
min2505.000-2513.000=-8.000
max2505.000-2513.000=-8.000
mean0.540-0.556=-0.016
σ0.519-0.557=-0.038
min0.272-0.276=-0.004
max1.319-1.391=-0.073
policies=20
mean1772.587-1772.569=0.017
σ0.337-0.322=0.015
min1772.366-1772.355=0.011
max1773.087-1773.047=0.040
mean760.000
σ0.000
min760.000
max760.000
mean2505.000-2513.000=-8.000
σ0.000
min2505.000-2513.000=-8.000
max2505.000-2513.000=-8.000
mean2.741-2.739=0.002
σ0.001-0.008=-0.007
min2.739-2.731=0.009
max2.742-2.747=-0.005
policies=200
mean17732.364-17732.535=-0.171
σ0.596-0.482=0.114
min17731.993-17732.257=-0.264
max17733.247-17733.257=-0.010
mean7600.000
σ0.000
min7600.000
max7600.000
mean2505.000-2513.000=-8.000
σ0.000
min2505.000-2513.000=-8.000
max2505.000-2513.000=-8.000
mean27.666-27.612=0.053
σ0.154-0.097=0.056
min27.521-27.493=0.028
max27.878-27.730=0.148