Compare commits

Home / Compare e2c811f5 .. df17e9d1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.384-30.958=39.426
σ0.047-0.049=-0.002
min70.352-30.921=39.431
max70.516-31.096=39.420
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.160-0.078=0.082
σ0.004-0.003=0.000
min0.154-0.072=0.082
max0.166-0.084=0.082
cache=y
dps=1
iters=10
policies=100
mean21.142-21.061=0.081
σ0.002-0.003=-0.001
min21.139-21.057=0.082
max21.144-21.068=0.076
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.064-0.063=0.001
σ0.002-0.003=-0.001
min0.058-0.061=-0.003
max0.067-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1751.412=0.982
σ0.361-0.363=-0.002
min1751.828-1750.846=0.982
max1752.977-1751.981=0.996
mean1657.900-1636.100=21.800
σ629.322-615.773=13.549
min618.000-648.000=-30.000
max2774.000-2467.000=307.000
mean2.809-2.701=0.108
σ0.149-0.257=-0.108
min2.331-2.182=0.148
max3.008-3.086=-0.078

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.144-273.380=-3.235
σ0.007-0.013=-0.006
min270.134-273.363=-3.229
max270.153-273.394=-3.241
mean2774.000-2467.000=307.000
σ0.000
min2774.000-2467.000=307.000
max2774.000-2467.000=307.000
mean0.377-0.388=-0.011
σ0.003-0.009=-0.006
min0.373-0.378=-0.005
max0.380-0.402=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1930.599-1933.840=-3.241
σ0.024-0.010=0.015
min1930.556-1933.829=-3.274
max1930.614-1933.851=-3.236
mean2774.000-2467.000=307.000
σ0.000
min2774.000-2467.000=307.000
max2774.000-2467.000=307.000
mean2.526-3.126=-0.600
σ0.062-0.169=-0.107
min2.482-2.941=-0.459
max2.633-3.354=-0.721
iters=5
new-facts=6402
prior-facts=1
mean4751.292-4754.220=-2.927
σ0.910-0.926=-0.016
min4750.762-4753.306=-2.544
max4752.912-4755.786=-2.874
mean2774.000-2467.000=307.000
σ0.000
min2774.000-2467.000=307.000
max2774.000-2467.000=307.000
mean8.631-8.625=0.006
σ0.533-0.432=0.101
min7.784-7.860=-0.076
max9.133-8.903=0.230
iters=5
new-facts=6402
prior-facts=6402
mean4941.761-4944.810=-3.049
σ0.033-0.086=-0.053
min4941.725-4944.743=-3.018
max4941.796-4944.905=-3.109
mean3017.400-3038.600=-21.200
σ236.710-419.760=-183.049
min2774.000-2475.000=299.000
max3331.000-3558.000=-227.000
mean8.587-8.726=-0.139
σ0.171-0.104=0.066
min8.430-8.636=-0.206
max8.845-8.878=-0.033

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.073-1.619=-0.546
σ0.096-0.056=0.040
min0.942-1.563=-0.620
max1.214-1.713=-0.498

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.379-463.333=3.046
σ575.942-572.195=3.747
min178.402-177.231=1.171
max1330.292-1321.625=8.667
mean84.250-79.750=4.500
σ8.500-7.500=1.000
min80.000-76.000=4.000
max97.000-91.000=6.000
mean2774.000-2467.000=307.000
σ0.000
min2774.000-2467.000=307.000
max2774.000-2467.000=307.000
mean0.442-0.565=-0.123
σ0.303-0.572=-0.269
min0.286-0.276=0.010
max0.897-1.423=-0.526
policies=20
mean1784.359-1772.576=11.782
σ0.368-0.325=0.043
min1784.119-1772.340=11.779
max1784.903-1773.057=11.847
mean800.000-760.000=40.000
σ0.000
min800.000-760.000=40.000
max800.000-760.000=40.000
mean2774.000-2467.000=307.000
σ0.000
min2774.000-2467.000=307.000
max2774.000-2467.000=307.000
mean2.850-2.724=0.126
σ0.084-0.008=0.076
min2.783-2.714=0.069
max2.962-2.734=0.228
policies=200
mean17849.641-17732.353=117.288
σ0.610-0.371=0.239
min17849.225-17732.108=117.117
max17850.542-17732.891=117.650
mean8000.000-7600.000=400.000
σ0.000
min8000.000-7600.000=400.000
max8000.000-7600.000=400.000
mean2774.000-2467.000=307.000
σ0.000
min2774.000-2467.000=307.000
max2774.000-2467.000=307.000
mean27.892-27.602=0.290
σ0.031-0.155=-0.124
min27.846-27.448=0.398
max27.915-27.818=0.097