Compare commits

Home / Compare 19273456 .. 04be5e10

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.387=0.003
σ0.046-0.045=0.000
min70.362-70.359=0.003
max70.518-70.514=0.004
mean415.000-415.100=-0.100
σ0.000-0.316=-0.316
min415.000
max415.000-416.000=-1.000
mean0.160-0.155=0.005
σ0.003-0.005=-0.002
min0.157-0.149=0.008
max0.164-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.002-0.002=0.000
min21.141-21.140=0.000
max21.150-21.147=0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.064-0.064=0.000
σ0.003-0.003=0.000
min0.062-0.060=0.002
max0.072-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.395=0.000
σ0.361-0.359=0.002
min1751.822-1751.824=-0.002
max1752.996-1752.957=0.038
mean1652.900-1628.350=24.550
σ615.234-589.738=25.496
min636.000-626.000=10.000
max2487.000-2416.000=71.000
mean2.807-2.812=-0.005
σ0.123-0.160=-0.038
min2.544-2.323=0.220
max2.996-3.053=-0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.146-270.144=0.002
σ0.005-0.005=0.000
min270.141-270.135=0.005
max270.153-270.148=0.005
mean2487.000-2416.000=71.000
σ0.000
min2487.000-2416.000=71.000
max2487.000-2416.000=71.000
mean0.383-0.385=-0.002
σ0.004-0.006=-0.002
min0.380-0.381=-0.001
max0.390-0.396=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.609-1930.609=-0.000
σ0.008-0.007=0.001
min1930.600-1930.601=-0.001
max1930.620-1930.617=0.003
mean2487.000-2416.000=71.000
σ0.000
min2487.000-2416.000=71.000
max2487.000-2416.000=71.000
mean2.562-2.490=0.072
σ0.131-0.125=0.007
min2.456-2.338=0.118
max2.787-2.671=0.116
iters=5
new-facts=6402
prior-facts=1
mean4751.312-4751.177=0.135
σ0.932-1.041=-0.109
min4750.791-4750.274=0.516
max4752.967-4752.973=-0.007
mean2487.000-2416.000=71.000
σ0.000
min2487.000-2416.000=71.000
max2487.000-2416.000=71.000
mean8.619-8.802=-0.183
σ0.483-0.334=0.149
min7.881-8.446=-0.564
max9.100-9.187=-0.088
iters=5
new-facts=6402
prior-facts=6402
mean4941.702-4941.778=-0.076
σ0.163-0.021=0.141
min4941.412-4941.753=-0.341
max4941.795-4941.805=-0.010
mean3016.000-2989.000=27.000
σ320.216-284.694=35.522
min2576.000-2600.000=-24.000
max3312.000-3326.000=-14.000
mean8.809-8.707=0.102
σ0.368-0.436=-0.068
min8.402-8.357=0.045
max9.323-9.431=-0.108

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.628-1.825=-0.197
σ0.117-0.166=-0.049
min1.455-1.565=-0.110
max1.772-1.965=-0.193

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.366-466.361=0.005
σ575.918-575.916=0.002
min178.402-178.399=0.003
max1330.244-1330.235=0.008
mean84.000
σ8.000
min80.000
max96.000
mean2487.000-2416.000=71.000
σ0.000
min2487.000-2416.000=71.000
max2487.000-2416.000=71.000
mean0.580-0.556=0.023
σ0.598-0.547=0.051
min0.279-0.280=-0.001
max1.477-1.377=0.100
policies=20
mean1784.322-1784.298=0.024
σ0.356-0.354=0.003
min1784.092-1784.071=0.020
max1784.852-1784.824=0.028
mean800.000
σ0.000
min800.000
max800.000
mean2487.000-2416.000=71.000
σ0.000
min2487.000-2416.000=71.000
max2487.000-2416.000=71.000
mean2.783-2.782=0.001
σ0.012-0.021=-0.010
min2.772-2.757=0.015
max2.797-2.807=-0.010
policies=200
mean17849.762-17849.769=-0.007
σ0.470-0.372=0.098
min17849.358-17849.455=-0.096
max17850.436-17850.299=0.137
mean8000.000
σ0.000
min8000.000
max8000.000
mean2487.000-2416.000=71.000
σ0.000
min2487.000-2416.000=71.000
max2487.000-2416.000=71.000
mean27.993-27.920=0.073
σ0.102-0.067=0.035
min27.890-27.828=0.062
max28.126-27.988=0.138