Compare commits

Home / Compare b30749c1 .. f63d2e8f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.778-70.695=0.083
σ0.052-0.048=0.004
min70.745-70.663=0.082
max70.920-70.826=0.095
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.157-0.160=-0.003
σ0.005-0.003=0.002
min0.150-0.157=-0.007
max0.165-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.494-21.423=0.071
σ0.003-0.002=0.000
min21.489-21.418=0.071
max21.497-21.426=0.071
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.064-0.062=0.001
σ0.004-0.004=0.000
min0.059-0.059=-0.000
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.880-1751.052=0.827
σ0.360-0.360=0.000
min1751.309-1750.481=0.828
max1752.465-1751.639=0.826
mean1655.050-1659.850=-4.800
σ626.062-625.987=0.075
min679.000-680.000=-1.000
max2657.000-2676.000=-19.000
mean2.823-2.751=0.072
σ0.196-0.202=-0.006
min2.135-2.263=-0.128
max3.113-2.986=0.127

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.378-270.111=-0.733
σ0.006-0.006=0.000
min269.371-270.106=-0.735
max269.385-270.118=-0.732
mean2657.000-2676.000=-19.000
σ0.000
min2657.000-2676.000=-19.000
max2657.000-2676.000=-19.000
mean0.381-0.386=-0.005
σ0.003-0.007=-0.003
min0.377-0.380=-0.003
max0.385-0.398=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1929.742-1930.479=-0.737
σ0.009-0.018=-0.009
min1929.727-1930.448=-0.721
max1929.752-1930.494=-0.742
mean2657.000-2676.000=-19.000
σ0.000
min2657.000-2676.000=-19.000
max2657.000-2676.000=-19.000
mean2.908-3.002=-0.094
σ0.100-0.188=-0.088
min2.799-2.749=0.050
max3.010-3.227=-0.217
iters=5
new-facts=6402
prior-facts=1
mean4750.478-4751.233=-0.756
σ0.953-0.926=0.027
min4749.987-4750.734=-0.747
max4752.180-4752.886=-0.706
mean2657.000-2676.000=-19.000
σ0.000
min2657.000-2676.000=-19.000
max2657.000-2676.000=-19.000
mean8.732-8.677=0.055
σ0.571-0.442=0.129
min7.821-8.015=-0.194
max9.219-9.136=0.083
iters=5
new-facts=6402
prior-facts=6402
mean4940.981-4941.717=-0.735
σ0.014-0.018=-0.003
min4940.964-4941.697=-0.733
max4940.997-4941.733=-0.735
mean2968.600-2974.400=-5.800
σ243.957-247.755=-3.798
min2657.000-2676.000=-19.000
max3299.000-3312.000=-13.000
mean8.465-8.485=-0.021
σ0.056-0.104=-0.048
min8.395-8.361=0.035
max8.523-8.625=-0.103

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.174=0.015
σ0.212-0.336=-0.124
min1.053-0.927=0.126
max1.551-1.564=-0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.056-465.786=0.271
σ574.934-574.937=-0.003
min178.585-178.314=0.271
max1328.458-1328.192=0.266
mean86.250
σ8.500
min82.000
max99.000
mean2657.000-2676.000=-19.000
σ0.000
min2657.000-2676.000=-19.000
max2657.000-2676.000=-19.000
mean0.573-0.562=0.011
σ0.588-0.551=0.037
min0.276-0.282=-0.006
max1.456-1.388=0.067
policies=20
mean1786.114-1783.426=2.687
σ0.362-0.362=-0.000
min1785.894-1783.204=2.690
max1786.655-1783.967=2.688
mean820.000
σ0.000
min820.000
max820.000
mean2657.000-2676.000=-19.000
σ0.000
min2657.000-2676.000=-19.000
max2657.000-2676.000=-19.000
mean2.775-2.778=-0.003
σ0.013-0.013=0.000
min2.759-2.765=-0.006
max2.786-2.793=-0.006
policies=200
mean17868.240-17841.260=26.980
σ0.480-0.462=0.018
min17867.863-17840.969=26.894
max17868.943-17841.945=26.997
mean8200.000
σ0.000
min8200.000
max8200.000
mean2657.000-2676.000=-19.000
σ0.000
min2657.000-2676.000=-19.000
max2657.000-2676.000=-19.000
mean28.004-27.911=0.093
σ0.180-0.086=0.095
min27.867-27.801=0.066
max28.270-27.995=0.275