Compare commits

Home / Compare 4df259a5 .. 8d2fe315

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.567=-0.003
σ0.044-0.043=0.001
min70.541-70.542=-0.001
max70.688-70.686=0.003
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.159-0.161=-0.002
σ0.005-0.003=0.001
min0.149-0.157=-0.008
max0.166-0.166=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.292-21.288=0.004
σ0.011-0.002=0.009
min21.285-21.283=0.001
max21.324-21.291=0.032
mean411.700-415.000=-3.300
σ0.483-0.000=0.483
min411.000-415.000=-4.000
max412.000-415.000=-3.000
mean0.065-0.065=0.000
σ0.002-0.002=0.000
min0.063-0.063=-0.000
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.568=0.001
σ0.361-0.361=-0.001
min1752.999-1752.998=0.001
max1754.151-1754.155=-0.004
mean1666.800-1656.650=10.150
σ643.748-643.662=0.086
min687.000-628.000=59.000
max2750.000-2888.000=-138.000
mean2.808-2.808=0.000
σ0.141-0.132=0.009
min2.398-2.495=-0.097
max3.006-2.962=0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.014-272.015=-0.002
σ0.010-0.005=0.004
min272.001-272.009=-0.008
max272.027-272.023=0.005
mean2750.000-2888.000=-138.000
σ0.000
min2750.000-2888.000=-138.000
max2750.000-2888.000=-138.000
mean0.396-0.387=0.009
σ0.016-0.009=0.006
min0.378-0.377=0.002
max0.419-0.395=0.025
iters=5
new-facts=1
prior-facts=6402
mean1932.440-1932.443=-0.002
σ0.018-0.008=0.009
min1932.423-1932.433=-0.010
max1932.466-1932.456=0.011
mean2750.000-2888.000=-138.000
σ0.000
min2750.000-2888.000=-138.000
max2750.000-2888.000=-138.000
mean2.883-2.984=-0.101
σ0.179-0.195=-0.016
min2.569-2.702=-0.132
max3.005-3.252=-0.246
iters=5
new-facts=6402
prior-facts=1
mean4753.108-4753.132=-0.024
σ0.937-0.896=0.042
min4752.237-4752.334=-0.097
max4754.710-4754.675=0.036
mean2750.000-2888.000=-138.000
σ0.000
min2750.000-2888.000=-138.000
max2750.000-2888.000=-138.000
mean8.173-7.913=0.260
σ0.411-0.332=0.079
min7.739-7.718=0.021
max8.639-8.494=0.145
iters=5
new-facts=6402
prior-facts=6402
mean4943.562-4943.631=-0.069
σ0.152-0.016=0.135
min4943.292-4943.607=-0.315
max4943.645-4943.647=-0.002
mean3039.400-3091.400=-52.000
σ342.720-285.164=57.556
min2750.000-2888.000=-138.000
max3548.000-3537.000=11.000
mean8.507-8.402=0.106
σ0.378-0.130=0.248
min8.238-8.300=-0.062
max9.172-8.610=0.562

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.994-1.042=-0.049
σ0.141-0.177=-0.036
min0.927-0.934=-0.007
max1.246-1.344=-0.098

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.090-473.082=0.009
σ575.941-575.915=0.026
min185.109-185.119=-0.010
max1337.002-1336.954=0.048
mean88.250
σ8.500
min84.000
max101.000
mean2750.000-2888.000=-138.000
σ0.000
min2750.000-2888.000=-138.000
max2750.000-2888.000=-138.000
mean0.544-0.458=0.085
σ0.507-0.319=0.188
min0.286-0.294=-0.008
max1.305-0.937=0.368
policies=20
mean1851.429-1851.457=-0.028
σ0.375-0.390=-0.015
min1851.180-1851.163=0.017
max1851.984-1852.023=-0.039
mean840.000
σ0.000
min840.000
max840.000
mean2750.000-2888.000=-138.000
σ0.000
min2750.000-2888.000=-138.000
max2750.000-2888.000=-138.000
mean2.879-2.965=-0.085
σ0.016-0.051=-0.035
min2.865-2.930=-0.066
max2.900-3.040=-0.140
policies=200
mean18521.152-18521.185=-0.033
σ0.509-0.361=0.149
min18520.862-18520.935=-0.073
max18521.914-18521.719=0.196
mean8400.000
σ0.000
min8400.000
max8400.000
mean2750.000-2888.000=-138.000
σ0.000
min2750.000-2888.000=-138.000
max2750.000-2888.000=-138.000
mean28.900-29.261=-0.361
σ0.174-0.537=-0.363
min28.724-28.769=-0.045
max29.136-29.835=-0.699