Compare commits

Home / Compare bddbaa62 .. ead7342b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.039-31.040=-0.001
σ0.049-0.050=-0.001
min31.004-31.001=0.002
max31.176-31.178=-0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.075-0.077=-0.001
σ0.005-0.004=0.001
min0.072-0.072=-0.000
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.003-0.002=0.000
min21.141-21.140=0.001
max21.149-21.146=0.003
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.065-0.065=0.000
σ0.003-0.002=0.001
min0.063-0.063=-0.000
max0.072-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.413=-0.002
σ0.360-0.362=-0.002
min1750.841-1750.840=0.000
max1751.990-1751.993=-0.003
mean1659.150-1663.550=-4.400
σ620.641-623.994=-3.353
min637.000-645.000=-8.000
max2501.000-2513.000=-12.000
mean2.859-2.822=0.037
σ0.109-0.146=-0.036
min2.538-2.263=0.275
max3.062-2.955=0.106

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.408-273.401=0.008
σ0.009-0.012=-0.002
min273.395-273.388=0.007
max273.420-273.415=0.005
mean2501.000-2513.000=-12.000
σ0.000
min2501.000-2513.000=-12.000
max2501.000-2513.000=-12.000
mean0.398-0.385=0.013
σ0.010-0.009=0.001
min0.380-0.377=0.003
max0.404-0.395=0.009
iters=5
new-facts=1
prior-facts=6402
mean1933.849-1933.835=0.014
σ0.017-0.009=0.008
min1933.828-1933.824=0.004
max1933.870-1933.845=0.024
mean2501.000-2513.000=-12.000
σ0.000
min2501.000-2513.000=-12.000
max2501.000-2513.000=-12.000
mean2.968-3.061=-0.094
σ0.104-0.091=0.014
min2.859-2.986=-0.127
max3.120-3.197=-0.077
iters=5
new-facts=6402
prior-facts=1
mean4754.290-4754.350=-0.060
σ0.936-0.868=0.068
min4753.597-4753.732=-0.135
max4755.937-4755.882=0.055
mean2501.000-2513.000=-12.000
σ0.000
min2501.000-2513.000=-12.000
max2501.000-2513.000=-12.000
mean8.143-8.598=-0.455
σ0.602-0.438=0.164
min7.753-8.103=-0.350
max9.193-9.183=0.010
iters=5
new-facts=6402
prior-facts=6402
mean4944.799-4944.791=0.008
σ0.084-0.089=-0.005
min4944.734-4944.710=0.024
max4944.896-4944.888=0.008
mean2925.400-2996.800=-71.400
σ400.173-281.468=118.706
min2501.000-2604.000=-103.000
max3460.000-3359.000=101.000
mean8.495-8.554=-0.060
σ0.097-0.175=-0.079
min8.384-8.410=-0.026
max8.616-8.816=-0.199

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.720-1.560=0.160
σ0.167-0.180=-0.012
min1.442-1.399=0.043
max1.891-1.835=0.056

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.333-463.338=-0.005
σ572.197-572.200=-0.003
min177.233-177.233=-0.000
max1321.628-1321.638=-0.010
mean79.750
σ7.500
min76.000
max91.000
mean2501.000-2513.000=-12.000
σ0.000
min2501.000-2513.000=-12.000
max2501.000-2513.000=-12.000
mean0.551-0.556=-0.005
σ0.536-0.557=-0.021
min0.274-0.276=-0.002
max1.355-1.391=-0.036
policies=20
mean1772.568-1772.569=-0.001
σ0.342-0.322=0.021
min1772.345-1772.355=-0.010
max1773.077-1773.047=0.030
mean760.000
σ0.000
min760.000
max760.000
mean2501.000-2513.000=-12.000
σ0.000
min2501.000-2513.000=-12.000
max2501.000-2513.000=-12.000
mean2.762-2.739=0.023
σ0.023-0.008=0.015
min2.740-2.731=0.009
max2.793-2.747=0.045
policies=200
mean17732.524-17732.535=-0.011
σ0.476-0.482=-0.006
min17732.260-17732.257=0.003
max17733.238-17733.257=-0.019
mean7600.000
σ0.000
min7600.000
max7600.000
mean2501.000-2513.000=-12.000
σ0.000
min2501.000-2513.000=-12.000
max2501.000-2513.000=-12.000
mean27.683-27.612=0.070
σ0.020-0.097=-0.078
min27.655-27.493=0.162
max27.702-27.730=-0.029