Compare commits

Home / Compare c4b2e019 .. eacba756

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.783=-0.001
σ0.046-0.048=-0.002
min70.752-70.745=0.007
max70.909-70.915=-0.005
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.160-0.162=-0.002
σ0.003-0.004=-0.001
min0.157-0.158=-0.001
max0.165-0.170=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.000
σ0.003-0.002=0.001
min21.489-21.490=-0.001
max21.498-21.495=0.003
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.066-0.067=-0.000
σ0.003-0.003=0.000
min0.064-0.065=-0.000
max0.072-0.075=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.096=-0.003
σ0.361-0.360=0.001
min1753.520-1753.539=-0.019
max1754.679-1754.680=-0.000
mean1630.050-1632.400=-2.350
σ596.962-606.260=-9.299
min655.000-643.000=12.000
max2425.000-2444.000=-19.000
mean2.802-2.863=-0.060
σ0.125-0.102=0.023
min2.539-2.669=-0.130
max2.926-3.145=-0.219

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.598-271.597=0.001
σ0.008-0.006=0.001
min271.589-271.590=-0.001
max271.607-271.604=0.002
mean2425.000-2444.000=-19.000
σ0.000
min2425.000-2444.000=-19.000
max2425.000-2444.000=-19.000
mean0.386-0.382=0.004
σ0.008-0.004=0.004
min0.380-0.380=-0.000
max0.398-0.388=0.010
iters=5
new-facts=1
prior-facts=6402
mean1932.002-1932.000=0.002
σ0.005-0.008=-0.003
min1931.993-1931.987=0.006
max1932.007-1932.010=-0.002
mean2425.000-2444.000=-19.000
σ0.000
min2425.000-2444.000=-19.000
max2425.000-2444.000=-19.000
mean2.517-2.509=0.008
σ0.061-0.120=-0.059
min2.470-2.366=0.104
max2.605-2.650=-0.045
iters=5
new-facts=6402
prior-facts=1
mean4752.711-4752.741=-0.029
σ0.922-0.910=0.012
min4752.229-4752.216=0.013
max4754.355-4754.357=-0.002
mean2425.000-2444.000=-19.000
σ0.000
min2425.000-2444.000=-19.000
max2425.000-2444.000=-19.000
mean8.816-8.580=0.235
σ0.329-0.497=-0.168
min8.335-7.742=0.593
max9.137-9.007=0.129
iters=5
new-facts=6402
prior-facts=6402
mean4943.206-4943.211=-0.006
σ0.017-0.021=-0.003
min4943.185-4943.184=0.001
max4943.231-4943.233=-0.002
mean3018.000-2957.200=60.800
σ260.986-240.625=20.361
min2624.000-2622.000=2.000
max3315.000-3283.000=32.000
mean8.560-8.546=0.014
σ0.128-0.182=-0.054
min8.434-8.446=-0.012
max8.735-8.869=-0.134

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.750-1.805=-0.055
σ0.067-0.042=0.025
min1.676-1.755=-0.079
max1.832-1.859=-0.027

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.629-468.628=0.001
σ574.921-574.922=-0.001
min181.163-181.165=-0.002
max1331.010-1331.011=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2425.000-2444.000=-19.000
σ0.000
min2425.000-2444.000=-19.000
max2425.000-2444.000=-19.000
mean0.576-0.551=0.025
σ0.577-0.526=0.051
min0.286-0.285=0.001
max1.442-1.340=0.102
policies=20
mean1811.967-1811.965=0.002
σ0.393-0.400=-0.007
min1811.696-1811.694=0.003
max1812.545-1812.555=-0.010
mean840.000
σ0.000
min840.000
max840.000
mean2425.000-2444.000=-19.000
σ0.000
min2425.000-2444.000=-19.000
max2425.000-2444.000=-19.000
mean2.851-2.851=-0.000
σ0.018-0.015=0.003
min2.834-2.831=0.003
max2.875-2.864=0.011
policies=200
mean18126.683-18126.696=-0.013
σ0.222-0.372=-0.149
min18126.493-18126.443=0.051
max18127.004-18127.249=-0.244
mean8400.000
σ0.000
min8400.000
max8400.000
mean2425.000-2444.000=-19.000
σ0.000
min2425.000-2444.000=-19.000
max2425.000-2444.000=-19.000
mean28.836-28.729=0.107
σ0.121-0.114=0.008
min28.716-28.615=0.100
max28.981-28.871=0.110