Compare commits

Home / Compare 2ad5ab89 .. f9b99b2d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.782=-0.001
σ0.045-0.053=-0.009
min70.750-70.751=-0.000
max70.905-70.932=-0.027
mean413.000
σ0.000
min413.000
max413.000
mean0.160-0.161=-0.001
σ0.004-0.003=0.001
min0.156-0.158=-0.003
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.494=-0.001
σ0.003-0.003=0.000
min21.488-21.490=-0.003
max21.498-21.497=0.000
mean413.000
σ0.000
min413.000
max413.000
mean0.065-0.066=-0.001
σ0.003-0.003=0.000
min0.064-0.064=-0.000
max0.073-0.073=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1751.883=2.209
σ0.361-0.361=-0.000
min1753.541-1751.309=2.232
max1754.681-1752.466=2.215
mean1631.200-1664.000=-32.800
σ609.390-631.643=-22.253
min642.000-682.000=-40.000
max2454.000-2771.000=-317.000
mean2.782-2.864=-0.082
σ0.221-0.097=0.124
min2.085-2.688=-0.603
max3.158-3.073=0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-269.383=2.572
σ0.006-0.006=-0.000
min271.947-269.373=2.574
max271.964-269.389=2.574
mean2454.000-2771.000=-317.000
σ0.000
min2454.000-2771.000=-317.000
max2454.000-2771.000=-317.000
mean0.382-0.378=0.004
σ0.008-0.003=0.005
min0.374-0.376=-0.001
max0.394-0.383=0.011
iters=5
new-facts=1
prior-facts=6402
mean1932.319-1929.743=2.576
σ0.012-0.020=-0.008
min1932.299-1929.718=2.581
max1932.331-1929.762=2.569
mean2454.000-2771.000=-317.000
σ0.000
min2454.000-2771.000=-317.000
max2454.000-2771.000=-317.000
mean3.074-2.986=0.088
σ0.131-0.127=0.004
min2.948-2.779=0.168
max3.276-3.129=0.147
iters=5
new-facts=6402
prior-facts=1
mean4753.061-4750.155=2.906
σ0.907-1.085=-0.179
min4752.593-4749.466=3.127
max4754.681-4752.046=2.635
mean2454.000-2771.000=-317.000
σ0.000
min2454.000-2771.000=-317.000
max2454.000-2771.000=-317.000
mean8.617-8.500=0.117
σ0.536-0.473=0.062
min7.717-7.744=-0.026
max9.092-8.991=0.101
iters=5
new-facts=6402
prior-facts=6402
mean4943.415-4940.928=2.487
σ0.309-0.135=0.173
min4942.863-4940.687=2.176
max4943.565-4941.005=2.560
mean2963.000-2983.600=-20.600
σ267.038-271.312=-4.274
min2602.000-2771.000=-169.000
max3314.000-3398.000=-84.000
mean8.450-8.433=0.016
σ0.084-0.121=-0.038
min8.376-8.354=0.023
max8.556-8.646=-0.089

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.753-1.110=0.644
σ0.154-0.252=-0.098
min1.533-0.935=0.599
max1.899-1.499=0.400

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.654-462.704=5.951
σ574.920-574.940=-0.019
min181.190-175.227=5.963
max1331.035-1325.113=5.922
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2454.000-2771.000=-317.000
σ0.000
min2454.000-2771.000=-317.000
max2454.000-2771.000=-317.000
mean0.561-0.440=0.121
σ0.554-0.307=0.247
min0.281-0.281=0.000
max1.392-0.901=0.491
policies=20
mean1812.199-1752.545=59.654
σ0.390-0.360=0.030
min1811.936-1752.295=59.641
max1812.774-1753.073=59.700
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2454.000-2771.000=-317.000
σ0.000
min2454.000-2771.000=-317.000
max2454.000-2771.000=-317.000
mean2.835-2.789=0.046
σ0.041-0.109=-0.068
min2.788-2.721=0.067
max2.887-2.952=-0.065
policies=200
mean18129.045-17532.417=596.628
σ0.534-0.500=0.035
min18128.618-17532.139=596.479
max18129.818-17533.166=596.653
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2454.000-2771.000=-317.000
σ0.000
min2454.000-2771.000=-317.000
max2454.000-2771.000=-317.000
mean28.480-27.650=0.831
σ0.020-0.098=-0.078
min28.453-27.557=0.895
max28.501-27.787=0.714