Compare commits

Home / Compare d548a7af .. 4bd5d562

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.378=0.012
σ0.046-0.045=0.001
min70.362-70.349=0.013
max70.517-70.503=0.014
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.156-0.157=-0.001
σ0.004-0.006=-0.002
min0.151-0.149=0.002
max0.162-0.168=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.002-0.003=-0.000
min21.141-21.140=0.000
max21.148-21.148=0.000
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.063-0.065=-0.002
σ0.003-0.003=0.000
min0.057-0.063=-0.005
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.387=0.008
σ0.361-0.361=0.000
min1751.822-1751.816=0.006
max1752.976-1752.950=0.026
mean1634.000-1631.600=2.400
σ623.166-597.441=25.725
min617.000-626.000=-9.000
max2770.000-2420.000=350.000
mean2.854-2.767=0.087
σ0.105-0.182=-0.078
min2.639-2.268=0.371
max3.093-2.965=0.128

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.126-270.129=-0.003
σ0.009-0.003=0.006
min270.117-270.125=-0.007
max270.139-270.133=0.006
mean2770.000-2420.000=350.000
σ0.000
min2770.000-2420.000=350.000
max2770.000-2420.000=350.000
mean0.378-0.382=-0.004
σ0.004-0.003=0.001
min0.371-0.379=-0.008
max0.383-0.387=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.601-1930.596=0.005
σ0.011-0.013=-0.002
min1930.581-1930.584=-0.003
max1930.609-1930.616=-0.007
mean2770.000-2420.000=350.000
σ0.000
min2770.000-2420.000=350.000
max2770.000-2420.000=350.000
mean2.493-2.500=-0.007
σ0.117-0.132=-0.014
min2.394-2.334=0.060
max2.686-2.692=-0.006
iters=5
new-facts=6402
prior-facts=1
mean4751.323-4750.992=0.330
σ0.976-0.553=0.423
min4750.767-4750.671=0.096
max4753.056-4751.978=1.078
mean2770.000-2420.000=350.000
σ0.000
min2770.000-2420.000=350.000
max2770.000-2420.000=350.000
mean8.680-8.295=0.385
σ0.717-0.594=0.123
min7.711-7.586=0.125
max9.639-8.990=0.648
iters=5
new-facts=6402
prior-facts=6402
mean4941.705-4941.458=0.247
σ0.157-0.215=-0.058
min4941.425-4941.106=0.319
max4941.796-4941.636=0.160
mean3048.400-2982.800=65.600
σ267.332-282.809=-15.478
min2770.000-2597.000=173.000
max3414.000-3319.000=95.000
mean8.540-8.622=-0.082
σ0.202-0.292=-0.090
min8.339-8.366=-0.027
max8.827-9.082=-0.255

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.023-1.805=-0.782
σ0.135-0.142=-0.008
min0.928-1.576=-0.647
max1.243-1.928=-0.685

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.387-466.353=0.035
σ575.962-575.913=0.050
min178.399-178.394=0.005
max1330.331-1330.222=0.109
mean84.250-84.000=0.250
σ8.500-8.000=0.500
min80.000
max97.000-96.000=1.000
mean2770.000-2420.000=350.000
σ0.000
min2770.000-2420.000=350.000
max2770.000-2420.000=350.000
mean0.568-0.561=0.007
σ0.579-0.567=0.012
min0.277-0.274=0.003
max1.437-1.412=0.025
policies=20
mean1784.333-1784.225=0.109
σ0.363-0.368=-0.005
min1784.100-1783.986=0.113
max1784.873-1784.772=0.101
mean800.000
σ0.000
min800.000
max800.000
mean2770.000-2420.000=350.000
σ0.000
min2770.000-2420.000=350.000
max2770.000-2420.000=350.000
mean2.775-2.791=-0.015
σ0.013-0.005=0.008
min2.765-2.785=-0.020
max2.795-2.797=-0.002
policies=200
mean17849.868-17848.855=1.013
σ0.517-0.350=0.167
min17849.549-17848.607=0.942
max17850.640-17849.372=1.268
mean8000.000
σ0.000
min8000.000
max8000.000
mean2770.000-2420.000=350.000
σ0.000
min2770.000-2420.000=350.000
max2770.000-2420.000=350.000
mean28.015-27.936=0.079
σ0.071-0.072=-0.001
min27.931-27.842=0.089
max28.103-28.016=0.087