Compare commits

Home / Compare c13612b4 .. 649983b2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.567=0.001
σ0.047-0.047=-0.000
min70.534-70.541=-0.007
max70.693-70.695=-0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.161-0.159=0.002
σ0.004-0.004=-0.000
min0.157-0.155=0.002
max0.168-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=-0.000
σ0.002-0.003=-0.001
min21.284-21.283=0.002
max21.291-21.294=-0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.065-0.065=-0.000
σ0.003-0.003=0.000
min0.063-0.063=-0.000
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.570-1753.569=0.001
σ0.359-0.362=-0.003
min1753.003-1752.999=0.004
max1754.150-1754.154=-0.004
mean1652.400-1652.150=0.250
σ645.077-638.844=6.234
min627.000-625.000=2.000
max2896.000-2851.000=45.000
mean2.818-2.807=0.010
σ0.110-0.124=-0.014
min2.510-2.489=0.020
max2.987-2.971=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.019-272.019=-0.000
σ0.006-0.007=-0.001
min272.011-272.011=-0.000
max272.025-272.028=-0.002
mean2896.000-2851.000=45.000
σ0.000
min2896.000-2851.000=45.000
max2896.000-2851.000=45.000
mean0.390-0.391=-0.001
σ0.012-0.005=0.006
min0.378-0.381=-0.003
max0.407-0.395=0.012
iters=5
new-facts=1
prior-facts=6402
mean1932.437-1932.435=0.003
σ0.022-0.008=0.014
min1932.413-1932.422=-0.009
max1932.470-1932.443=0.028
mean2896.000-2851.000=45.000
σ0.000
min2896.000-2851.000=45.000
max2896.000-2851.000=45.000
mean2.929-3.021=-0.092
σ0.277-0.094=0.183
min2.455-2.937=-0.481
max3.175-3.180=-0.005
iters=5
new-facts=6402
prior-facts=1
mean4753.212-4753.108=0.104
σ0.876-0.564=0.312
min4752.695-4752.807=-0.112
max4754.770-4754.112=0.658
mean2896.000-2851.000=45.000
σ0.000
min2896.000-2851.000=45.000
max2896.000-2851.000=45.000
mean8.287-8.258=0.030
σ0.464-0.397=0.067
min7.736-7.775=-0.040
max8.934-8.598=0.336
iters=5
new-facts=6402
prior-facts=6402
mean4943.550-4943.629=-0.079
σ0.170-0.028=0.142
min4943.246-4943.588=-0.342
max4943.642-4943.657=-0.015
mean3063.800-3073.000=-9.200
σ234.536-226.723=7.813
min2896.000-2851.000=45.000
max3432.000-3406.000=26.000
mean8.437-8.535=-0.098
σ0.082-0.149=-0.066
min8.373-8.411=-0.038
max8.576-8.766=-0.190

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.055-1.057=-0.002
σ0.128-0.265=-0.137
min0.938-0.931=0.008
max1.250-1.530=-0.280

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.106-473.111=-0.005
σ575.923-575.926=-0.002
min185.135-185.138=-0.003
max1336.991-1337.000=-0.008
mean88.250
σ8.500
min84.000
max101.000
mean2896.000-2851.000=45.000
σ0.000
min2896.000-2851.000=45.000
max2896.000-2851.000=45.000
mean0.485-0.450=0.035
σ0.371-0.300=0.071
min0.298-0.296=0.002
max1.041-0.899=0.142
policies=20
mean1851.709-1851.714=-0.005
σ0.370-0.379=-0.009
min1851.435-1851.420=0.015
max1852.247-1852.264=-0.017
mean840.000
σ0.000
min840.000
max840.000
mean2896.000-2851.000=45.000
σ0.000
min2896.000-2851.000=45.000
max2896.000-2851.000=45.000
mean2.940-2.952=-0.012
σ0.014-0.010=0.004
min2.927-2.942=-0.016
max2.960-2.963=-0.003
policies=200
mean18523.651-18523.596=0.055
σ0.419-0.343=0.076
min18523.353-18523.294=0.059
max18524.271-18524.081=0.189
mean8400.000
σ0.000
min8400.000
max8400.000
mean2896.000-2851.000=45.000
σ0.000
min2896.000-2851.000=45.000
max2896.000-2851.000=45.000
mean29.240-29.224=0.017
σ0.506-0.413=0.094
min28.750-28.821=-0.071
max29.684-29.752=-0.069