Compare commits

Home / Compare 22c18d1d .. c6f187ce

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.567=-0.005
σ0.045-0.046=-0.001
min70.543-70.539=0.003
max70.689-70.692=-0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.158-0.159=-0.001
σ0.005-0.004=0.001
min0.150-0.154=-0.003
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.289-21.288=0.000
σ0.003-0.002=0.001
min21.283-21.285=-0.002
max21.295-21.291=0.004
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.065-0.065=0.001
σ0.002-0.003=-0.001
min0.063-0.063=0.001
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.570-1753.570=-0.000
σ0.359-0.360=-0.000
min1752.998-1752.999=-0.001
max1754.159-1754.154=0.004
mean1655.100-1658.400=-3.300
σ645.290-632.078=13.212
min628.000-645.000=-17.000
max2900.000-2855.000=45.000
mean2.814-2.733=0.080
σ0.147-0.270=-0.124
min2.419-2.166=0.254
max2.988-3.165=-0.178

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.475-272.020=5.455
σ0.005-0.005=0.000
min277.471-272.015=5.456
max277.482-272.027=5.455
mean2900.000-2855.000=45.000
σ0.000
min2900.000-2855.000=45.000
max2900.000-2855.000=45.000
mean0.393-0.392=0.001
σ0.005-0.009=-0.004
min0.388-0.380=0.008
max0.400-0.404=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1937.902-1932.443=5.459
σ0.011-0.005=0.006
min1937.884-1932.437=5.447
max1937.912-1932.450=5.462
mean2900.000-2855.000=45.000
σ0.000
min2900.000-2855.000=45.000
max2900.000-2855.000=45.000
mean2.969-2.937=0.033
σ0.031-0.089=-0.058
min2.926-2.836=0.090
max2.999-3.064=-0.065
iters=5
new-facts=6402
prior-facts=1
mean4758.610-4752.873=5.737
σ0.918-0.768=0.150
min4758.167-4752.108=6.058
max4760.250-4754.121=6.129
mean2900.000-2855.000=45.000
σ0.000
min2900.000-2855.000=45.000
max2900.000-2855.000=45.000
mean8.703-8.196=0.506
σ0.222-0.619=-0.397
min8.394-7.689=0.705
max8.966-9.139=-0.173
iters=5
new-facts=6402
prior-facts=6402
mean4949.109-4943.560=5.549
σ0.024-0.161=-0.138
min4949.082-4943.273=5.809
max4949.137-4943.648=5.490
mean3041.000-3067.800=-26.800
σ169.462-277.793=-108.330
min2900.000-2855.000=45.000
max3315.000-3498.000=-183.000
mean8.634-8.495=0.139
σ0.122-0.191=-0.069
min8.513-8.381=0.132
max8.825-8.829=-0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.017-1.026=-0.009
σ0.117-0.141=-0.024
min0.935-0.933=0.003
max1.202-1.255=-0.053

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.080-473.082=-0.002
σ575.915-575.916=-0.001
min185.120-185.115=0.005
max1336.952-1336.955=-0.004
mean88.250
σ8.500
min84.000
max101.000
mean2900.000-2855.000=45.000
σ0.000
min2900.000-2855.000=45.000
max2900.000-2855.000=45.000
mean0.488-0.449=0.038
σ0.380-0.300=0.080
min0.296-0.294=0.002
max1.058-0.900=0.158
policies=20
mean1851.459-1851.443=0.017
σ0.378-0.367=0.011
min1851.179-1851.173=0.006
max1852.011-1851.976=0.035
mean840.000
σ0.000
min840.000
max840.000
mean2900.000-2855.000=45.000
σ0.000
min2900.000-2855.000=45.000
max2900.000-2855.000=45.000
mean2.927-2.949=-0.022
σ0.018-0.009=0.009
min2.905-2.938=-0.034
max2.947-2.957=-0.010
policies=200
mean18521.195-18521.135=0.060
σ0.414-0.504=-0.090
min18520.937-18520.793=0.143
max18521.806-18521.883=-0.077
mean8400.000
σ0.000
min8400.000
max8400.000
mean2900.000-2855.000=45.000
σ0.000
min2900.000-2855.000=45.000
max2900.000-2855.000=45.000
mean29.087-29.245=-0.158
σ0.423-0.531=-0.108
min28.683-28.780=-0.098
max29.550-29.718=-0.168