Compare commits

Home / Compare 9b7743c8 .. d59ec315

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.782=0.001
σ0.047-0.046=0.001
min70.749-70.747=0.003
max70.912-70.909=0.004
mean414.600-411.500=3.100
σ0.516-0.527=-0.011
min414.000-411.000=3.000
max415.000-412.000=3.000
mean0.161-0.161=-0.000
σ0.004-0.003=0.001
min0.154-0.158=-0.004
max0.169-0.165=0.004
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.001
σ0.003-0.003=-0.000
min21.490-21.489=0.000
max21.498-21.497=0.000
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.063-0.066=-0.003
σ0.003-0.002=0.001
min0.060-0.065=-0.005
max0.068-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.092=0.001
σ0.360-0.358=0.002
min1753.529-1753.537=-0.008
max1754.674-1754.666=0.009
mean1654.100-1637.550=16.550
σ622.764-617.912=4.851
min628.000-641.000=-13.000
max2771.000-2476.000=295.000
mean2.765-2.821=-0.056
σ0.177-0.187=-0.010
min2.295-2.446=-0.152
max3.051-3.222=-0.172

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.599-271.600=-0.001
σ0.005-0.004=0.001
min271.591-271.593=-0.002
max271.604-271.605=-0.000
mean2771.000-2476.000=295.000
σ0.000
min2771.000-2476.000=295.000
max2771.000-2476.000=295.000
mean0.385-0.383=0.002
σ0.004-0.004=-0.000
min0.381-0.378=0.003
max0.390-0.389=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.003-1931.995=0.008
σ0.010-0.019=-0.009
min1931.989-1931.962=0.027
max1932.016-1932.007=0.009
mean2771.000-2476.000=295.000
σ0.000
min2771.000-2476.000=295.000
max2771.000-2476.000=295.000
mean2.516-2.496=0.021
σ0.084-0.044=0.039
min2.405-2.461=-0.056
max2.603-2.564=0.039
iters=5
new-facts=6402
prior-facts=1
mean4752.733-4752.728=0.005
σ0.916-0.853=0.063
min4752.222-4752.223=-0.002
max4754.365-4754.248=0.117
mean2771.000-2476.000=295.000
σ0.000
min2771.000-2476.000=295.000
max2771.000-2476.000=295.000
mean8.852-8.700=0.152
σ0.268-0.327=-0.059
min8.551-8.367=0.183
max9.230-9.149=0.081
iters=5
new-facts=6402
prior-facts=6402
mean4943.136-4943.133=0.003
σ0.151-0.166=-0.014
min4942.870-4942.839=0.031
max4943.233-4943.225=0.008
mean3018.600-3013.000=5.600
σ224.724-262.225=-37.501
min2771.000-2622.000=149.000
max3311.000-3324.000=-13.000
mean8.541-8.632=-0.091
σ0.088-0.249=-0.161
min8.439-8.393=0.046
max8.646-8.904=-0.257

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.737=-0.735
σ0.142-0.138=0.003
min0.939-1.563=-0.624
max1.256-1.912=-0.656

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.637-468.627=0.010
σ574.924-574.920=0.004
min181.164-181.163=0.001
max1331.022-1331.007=0.015
mean88.250
σ8.500
min84.000
max101.000
mean2771.000-2476.000=295.000
σ0.000
min2771.000-2476.000=295.000
max2771.000-2476.000=295.000
mean0.446-0.558=-0.113
σ0.294-0.534=-0.240
min0.297-0.288=0.009
max0.886-1.359=-0.473
policies=20
mean1811.970-1811.940=0.030
σ0.389-0.399=-0.010
min1811.696-1811.666=0.030
max1812.539-1812.526=0.013
mean840.000
σ0.000
min840.000
max840.000
mean2771.000-2476.000=295.000
σ0.000
min2771.000-2476.000=295.000
max2771.000-2476.000=295.000
mean2.911-2.852=0.059
σ0.093-0.013=0.080
min2.835-2.837=-0.002
max3.034-2.865=0.169
policies=200
mean18126.639-18126.654=-0.015
σ0.402-0.390=0.012
min18126.257-18126.319=-0.062
max18127.197-18127.216=-0.019
mean8400.000
σ0.000
min8400.000
max8400.000
mean2771.000-2476.000=295.000
σ0.000
min2771.000-2476.000=295.000
max2771.000-2476.000=295.000
mean28.684-28.605=0.079
σ0.121-0.092=0.029
min28.582-28.492=0.090
max28.856-28.682=0.175