Compare commits

Home / Compare 2aae9c4c .. c4b2e019

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.781=0.002
σ0.048-0.044=0.004
min70.745-70.750=-0.005
max70.915-70.905=0.010
mean416.000-416.500=-0.500
σ0.000-0.527=-0.527
min416.000
max416.000-417.000=-1.000
mean0.162-0.159=0.003
σ0.004-0.006=-0.002
min0.158-0.153=0.005
max0.170-0.168=0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.000
σ0.002-0.003=-0.001
min21.490-21.489=0.002
max21.495-21.496=-0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.067-0.066=0.000
σ0.003-0.002=0.001
min0.065-0.065=-0.000
max0.075-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.096-1754.094=0.002
σ0.360-0.360=-0.000
min1753.539-1753.529=0.011
max1754.680-1754.681=-0.001
mean1632.400-1656.250=-23.850
σ606.260-626.150=-19.890
min643.000-629.000=14.000
max2444.000-2774.000=-330.000
mean2.863-2.855=0.007
σ0.102-0.121=-0.019
min2.669-2.522=0.147
max3.145-3.079=0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.597-271.600=-0.003
σ0.006-0.008=-0.002
min271.590-271.590=-0.000
max271.604-271.608=-0.004
mean2444.000-2774.000=-330.000
σ0.000
min2444.000-2774.000=-330.000
max2444.000-2774.000=-330.000
mean0.382-0.388=-0.006
σ0.004-0.007=-0.004
min0.380-0.381=-0.002
max0.388-0.397=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.000-1932.005=-0.006
σ0.008-0.007=0.001
min1931.987-1931.996=-0.009
max1932.010-1932.014=-0.004
mean2444.000-2774.000=-330.000
σ0.000
min2444.000-2774.000=-330.000
max2444.000-2774.000=-330.000
mean2.509-2.480=0.029
σ0.120-0.101=0.019
min2.366-2.364=0.002
max2.650-2.586=0.064
iters=5
new-facts=6402
prior-facts=1
mean4752.741-4752.719=0.022
σ0.910-0.893=0.017
min4752.216-4752.294=-0.078
max4754.357-4754.316=0.041
mean2444.000-2774.000=-330.000
σ0.000
min2444.000-2774.000=-330.000
max2444.000-2774.000=-330.000
mean8.580-8.669=-0.089
σ0.497-0.164=0.333
min7.742-8.513=-0.771
max9.007-8.873=0.134
iters=5
new-facts=6402
prior-facts=6402
mean4943.211-4943.207=0.004
σ0.021-0.015=0.006
min4943.184-4943.192=-0.008
max4943.233-4943.231=0.002
mean2957.200-3046.600=-89.400
σ240.625-211.161=29.464
min2622.000-2774.000=-152.000
max3283.000-3328.000=-45.000
mean8.546-8.599=-0.053
σ0.182-0.183=-0.001
min8.446-8.449=-0.003
max8.869-8.848=0.021

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.805-1.050=0.755
σ0.042-0.135=-0.093
min1.755-0.929=0.826
max1.859-1.260=0.599

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.628-468.631=-0.003
σ574.922-574.929=-0.007
min181.165-181.164=0.001
max1331.011-1331.024=-0.013
mean88.250
σ8.500
min84.000
max101.000
mean2444.000-2774.000=-330.000
σ0.000
min2444.000-2774.000=-330.000
max2444.000-2774.000=-330.000
mean0.551-0.446=0.105
σ0.526-0.303=0.223
min0.285-0.292=-0.007
max1.340-0.901=0.440
policies=20
mean1811.965-1811.985=-0.020
σ0.400-0.401=-0.001
min1811.694-1811.697=-0.003
max1812.555-1812.572=-0.017
mean840.000
σ0.000
min840.000
max840.000
mean2444.000-2774.000=-330.000
σ0.000
min2444.000-2774.000=-330.000
max2444.000-2774.000=-330.000
mean2.851-2.916=-0.066
σ0.015-0.093=-0.078
min2.831-2.836=-0.005
max2.864-3.045=-0.181
policies=200
mean18126.696-18126.792=-0.095
σ0.372-0.499=-0.127
min18126.443-18126.492=-0.049
max18127.249-18127.537=-0.288
mean8400.000
σ0.000
min8400.000
max8400.000
mean2444.000-2774.000=-330.000
σ0.000
min2444.000-2774.000=-330.000
max2444.000-2774.000=-330.000
mean28.729-28.684=0.045
σ0.114-0.113=0.001
min28.615-28.596=0.019
max28.871-28.840=0.031