Compare commits

Home / Compare 68d89c13 .. ae2250be

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.703=-0.002
σ0.046-0.048=-0.001
min70.671-70.667=0.004
max70.829-70.834=-0.005
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.155-0.158=-0.003
σ0.005-0.005=-0.000
min0.149-0.150=-0.000
max0.164-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.409-21.408=0.000
σ0.003-0.003=0.001
min21.406-21.405=0.001
max21.415-21.412=0.004
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.063-0.066=-0.002
σ0.004-0.003=0.001
min0.058-0.064=-0.005
max0.069-0.073=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.929-1754.930=-0.001
σ0.358-0.360=-0.002
min1754.357-1754.354=0.003
max1755.497-1755.519=-0.022
mean1649.650-1645.600=4.050
σ632.251-631.984=0.266
min633.000-622.000=11.000
max2790.000-2772.000=18.000
mean2.819-2.814=0.004
σ0.172-0.181=-0.009
min2.377-2.467=-0.090
max3.148-3.194=-0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.756-272.755=0.000
σ0.007-0.009=-0.002
min272.748-272.746=0.002
max272.765-272.768=-0.003
mean2790.000-2772.000=18.000
σ0.000
min2790.000-2772.000=18.000
max2790.000-2772.000=18.000
mean0.382-0.383=-0.000
σ0.007-0.009=-0.001
min0.378-0.378=0.000
max0.395-0.398=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.157-1933.167=-0.010
σ0.014-0.011=0.003
min1933.137-1933.155=-0.017
max1933.176-1933.182=-0.006
mean2790.000-2772.000=18.000
σ0.000
min2790.000-2772.000=18.000
max2790.000-2772.000=18.000
mean3.029-3.027=0.003
σ0.087-0.170=-0.084
min2.899-2.819=0.080
max3.143-3.233=-0.090
iters=5
new-facts=6402
prior-facts=1
mean4756.919-4757.016=-0.097
σ7.625-7.521=0.105
min4753.466-4753.588=-0.122
max4770.559-4770.469=0.090
mean2790.000-2772.000=18.000
σ0.000
min2790.000-2772.000=18.000
max2790.000-2772.000=18.000
mean8.595-7.981=0.613
σ0.319-0.236=0.082
min8.071-7.730=0.342
max8.854-8.358=0.496
iters=5
new-facts=6402
prior-facts=6402
mean4944.326-4944.401=-0.075
σ0.150-0.017=0.133
min4944.058-4944.379=-0.321
max4944.404-4944.420=-0.016
mean3018.800-3018.600=0.200
σ213.187-304.273=-91.086
min2790.000-2772.000=18.000
max3292.000-3473.000=-181.000
mean8.597-8.620=-0.023
σ0.098-0.227=-0.129
min8.483-8.411=0.072
max8.711-8.941=-0.230

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.135-1.028=0.107
σ0.197-0.132=0.065
min0.917-0.916=0.001
max1.407-1.238=0.169

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.339-468.343=-0.003
σ574.252-574.255=-0.003
min181.204-181.207=-0.004
max1329.717-1329.725=-0.008
mean88.250
σ8.500
min84.000
max101.000
mean2790.000-2772.000=18.000
σ0.000
min2790.000-2772.000=18.000
max2790.000-2772.000=18.000
mean0.442-0.462=-0.019
σ0.303-0.337=-0.034
min0.290-0.292=-0.002
max0.897-0.968=-0.071
policies=20
mean1812.329-1812.369=-0.039
σ0.391-0.391=-0.001
min1812.073-1812.098=-0.025
max1812.907-1812.945=-0.038
mean840.000
σ0.000
min840.000
max840.000
mean2790.000-2772.000=18.000
σ0.000
min2790.000-2772.000=18.000
max2790.000-2772.000=18.000
mean2.882-2.876=0.005
σ0.009-0.007=0.002
min2.872-2.868=0.004
max2.893-2.886=0.008
policies=200
mean18128.920-18129.136=-0.216
σ0.455-0.447=0.008
min18128.541-18128.759=-0.217
max18129.581-18129.768=-0.187
mean8400.000
σ0.000
min8400.000
max8400.000
mean2790.000-2772.000=18.000
σ0.000
min2790.000-2772.000=18.000
max2790.000-2772.000=18.000
mean28.461-28.494=-0.032
σ0.224-0.209=0.015
min28.314-28.305=0.009
max28.795-28.732=0.063