Compare commits

Home / Compare 573aab0b .. 27610d98

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-30.958=0.082
σ0.050-0.049=0.001
min31.001-30.920=0.081
max31.178-31.092=0.086
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.077-0.075=0.002
σ0.004-0.005=-0.001
min0.072-0.069=0.003
max0.084-0.082=0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.061=0.082
σ0.002-0.002=-0.000
min21.140-21.057=0.083
max21.146-21.065=0.081
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.065-0.065=0.000
σ0.002-0.004=-0.001
min0.063-0.062=0.001
max0.071-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.413-1751.411=0.002
σ0.362-0.361=0.001
min1750.840-1750.843=-0.002
max1751.993-1751.975=0.018
mean1663.550-1641.950=21.600
σ623.994-619.491=4.503
min645.000-652.000=-7.000
max2513.000-2480.000=33.000
mean2.822-2.785=0.037
σ0.146-0.202=-0.056
min2.263-2.349=-0.086
max2.955-3.225=-0.270

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.401-273.402=-0.002
σ0.012-0.010=0.002
min273.388-273.389=-0.001
max273.415-273.416=-0.001
mean2513.000-2480.000=33.000
σ0.000
min2513.000-2480.000=33.000
max2513.000-2480.000=33.000
mean0.385-0.381=0.004
σ0.009-0.010=-0.001
min0.377-0.375=0.002
max0.395-0.398=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1933.835-1933.841=-0.007
σ0.009-0.004=0.005
min1933.824-1933.835=-0.011
max1933.845-1933.845=0.000
mean2513.000-2480.000=33.000
σ0.000
min2513.000-2480.000=33.000
max2513.000-2480.000=33.000
mean3.061-3.008=0.053
σ0.091-0.140=-0.049
min2.986-2.855=0.132
max3.197-3.217=-0.020
iters=5
new-facts=6402
prior-facts=1
mean4754.350-4754.248=0.102
σ0.868-0.593=0.275
min4753.732-4753.735=-0.003
max4755.882-4755.271=0.611
mean2513.000-2480.000=33.000
σ0.000
min2513.000-2480.000=33.000
max2513.000-2480.000=33.000
mean8.598-8.582=0.016
σ0.438-0.650=-0.212
min8.103-7.671=0.431
max9.183-9.496=-0.314
iters=5
new-facts=6402
prior-facts=6402
mean4944.791-4944.805=-0.014
σ0.089-0.091=-0.002
min4944.710-4944.738=-0.028
max4944.888-4944.910=-0.022
mean2996.800-3010.200=-13.400
σ281.468-314.234=-32.766
min2604.000-2594.000=10.000
max3359.000-3405.000=-46.000
mean8.554-8.757=-0.202
σ0.175-0.420=-0.245
min8.410-8.414=-0.004
max8.816-9.483=-0.667

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.560-1.806=-0.246
σ0.180-0.084=0.096
min1.399-1.665=-0.266
max1.835-1.876=-0.041

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.338-463.333=0.005
σ572.200-572.194=0.006
min177.233-177.234=-0.002
max1321.638-1321.624=0.014
mean79.750
σ7.500
min76.000
max91.000
mean2513.000-2480.000=33.000
σ0.000
min2513.000-2480.000=33.000
max2513.000-2480.000=33.000
mean0.556-0.552=0.004
σ0.557-0.547=0.010
min0.276-0.274=0.002
max1.391-1.373=0.019
policies=20
mean1772.569-1772.588=-0.019
σ0.322-0.335=-0.013
min1772.355-1772.367=-0.012
max1773.047-1773.084=-0.038
mean760.000
σ0.000
min760.000
max760.000
mean2513.000-2480.000=33.000
σ0.000
min2513.000-2480.000=33.000
max2513.000-2480.000=33.000
mean2.739-2.751=-0.012
σ0.008-0.021=-0.013
min2.731-2.725=0.006
max2.747-2.775=-0.027
policies=200
mean17732.535-17732.417=0.118
σ0.482-0.432=0.050
min17732.257-17732.143=0.115
max17733.257-17733.060=0.197
mean7600.000
σ0.000
min7600.000
max7600.000
mean2513.000-2480.000=33.000
σ0.000
min2513.000-2480.000=33.000
max2513.000-2480.000=33.000
mean27.612-27.628=-0.016
σ0.097-0.184=-0.086
min27.493-27.506=-0.013
max27.730-27.900=-0.169