Compare commits

Home / Compare 4b4d4499 .. 751ea797

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.616-35.617=-0.001
σ0.055-0.054=0.001
min35.584-35.590=-0.006
max35.772-35.770=0.002
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.082-0.085=-0.003
σ0.005-0.003=0.002
min0.076-0.082=-0.006
max0.089-0.091=-0.003
cache=y
dps=1
iters=10
policies=100
mean24.046-24.048=-0.002
σ0.002-0.003=-0.000
min24.043-24.044=-0.001
max24.049-24.051=-0.002
mean416.600-412.000=4.600
σ0.516-0.000=0.516
min416.000-412.000=4.000
max417.000-412.000=5.000
mean0.066-0.067=-0.001
σ0.005-0.005=-0.000
min0.061-0.061=0.000
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.491=-0.001
σ0.364-0.365=-0.002
min1755.914-1755.916=-0.001
max1757.078-1757.085=-0.006
mean1653.650-1645.650=8.000
σ628.929-640.550=-11.620
min623.000-630.000=-7.000
max2708.000-2823.000=-115.000
mean2.346-2.351=-0.005
σ0.111-0.067=0.044
min2.209-2.270=-0.061
max2.635-2.484=0.150

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.760-324.736=0.024
σ0.058-0.043=0.015
min324.657-324.661=-0.004
max324.791-324.771=0.020
mean2708.000-2823.000=-115.000
σ0.000
min2708.000-2823.000=-115.000
max2708.000-2823.000=-115.000
mean0.430-0.427=0.002
σ0.008-0.005=0.004
min0.424-0.424=-0.000
max0.443-0.436=0.008
iters=5
new-facts=1
prior-facts=6402
mean1985.319-1985.328=-0.009
σ0.015-0.007=0.007
min1985.301-1985.319=-0.018
max1985.336-1985.337=-0.001
mean2708.000-2823.000=-115.000
σ0.000
min2708.000-2823.000=-115.000
max2708.000-2823.000=-115.000
mean2.591-2.639=-0.048
σ0.081-0.091=-0.011
min2.512-2.580=-0.068
max2.704-2.794=-0.090
iters=5
new-facts=6402
prior-facts=1
mean4808.994-4808.986=0.008
σ7.703-7.756=-0.052
min4804.996-4804.968=0.028
max4822.762-4822.848=-0.086
mean2708.000-2823.000=-115.000
σ0.000
min2708.000-2823.000=-115.000
max2708.000-2823.000=-115.000
mean8.723-8.776=-0.053
σ0.427-0.563=-0.136
min8.111-7.784=0.327
max9.082-9.115=-0.033
iters=5
new-facts=6402
prior-facts=6402
mean4996.629-4996.634=-0.005
σ0.021-0.019=0.002
min4996.604-4996.610=-0.006
max4996.653-4996.656=-0.003
mean2981.800-3035.200=-53.400
σ319.080-205.359=113.722
min2708.000-2823.000=-115.000
max3454.000-3288.000=166.000
mean8.595-8.670=-0.076
σ0.160-0.150=0.010
min8.484-8.506=-0.022
max8.877-8.847=0.031

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.972-0.945=0.027
σ0.069-0.049=0.020
min0.913-0.911=0.002
max1.049-1.030=0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.216-463.202=0.013
σ574.771-574.767=0.003
min175.815-175.813=0.002
max1325.371-1325.353=0.018
mean86.250
σ8.500
min82.000
max99.000
mean2708.000-2823.000=-115.000
σ0.000
min2708.000-2823.000=-115.000
max2708.000-2823.000=-115.000
mean0.547-0.433=0.114
σ0.550-0.300=0.250
min0.269-0.283=-0.014
max1.373-0.884=0.489
policies=20
mean1758.502-1758.503=-0.001
σ0.336-0.355=-0.020
min1758.292-1758.272=0.019
max1759.003-1759.030=-0.028
mean820.000
σ0.000
min820.000
max820.000
mean2708.000-2823.000=-115.000
σ0.000
min2708.000-2823.000=-115.000
max2708.000-2823.000=-115.000
mean2.726-2.803=-0.077
σ0.026-0.005=0.020
min2.699-2.799=-0.100
max2.760-2.810=-0.050
policies=200
mean17592.020-17592.068=-0.047
σ0.555-0.493=0.062
min17591.644-17591.768=-0.123
max17592.841-17592.799=0.042
mean8200.000
σ0.000
min8200.000
max8200.000
mean2708.000-2823.000=-115.000
σ0.000
min2708.000-2823.000=-115.000
max2708.000-2823.000=-115.000
mean27.645-28.004=-0.359
σ0.233-0.559=-0.326
min27.411-27.504=-0.093
max27.900-28.701=-0.800