Compare commits

Home / Compare 54b76627 .. 743c53e3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.567=-0.001
σ0.047-0.043=0.004
min70.534-70.544=-0.010
max70.696-70.686=0.011
mean411.100-416.000=-4.900
σ0.316-0.000=0.316
min411.000-416.000=-5.000
max412.000-416.000=-4.000
mean0.159-0.159=0.001
σ0.005-0.003=0.002
min0.151-0.155=-0.005
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.002=0.000
min21.284-21.285=-0.001
max21.293-21.292=0.001
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.063-0.063=0.000
σ0.004-0.004=-0.000
min0.060-0.058=0.002
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.568=0.002
σ0.360-0.362=-0.001
min1752.993-1752.994=-0.002
max1754.154-1754.152=0.002
mean1651.650-1669.550=-17.900
σ638.069-631.584=6.485
min620.000-681.000=-61.000
max2846.000-2699.000=147.000
mean2.797-2.817=-0.020
σ0.212-0.129=0.082
min2.210-2.518=-0.308
max2.998-3.061=-0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.993-272.012=-0.019
σ0.008-0.007=0.001
min271.985-272.000=-0.015
max272.004-272.017=-0.013
mean2846.000-2699.000=147.000
σ0.000
min2846.000-2699.000=147.000
max2846.000-2699.000=147.000
mean0.394-0.391=0.003
σ0.014-0.011=0.002
min0.381-0.380=0.000
max0.415-0.407=0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.433-1932.437=-0.003
σ0.014-0.006=0.008
min1932.417-1932.426=-0.009
max1932.449-1932.443=0.006
mean2846.000-2699.000=147.000
σ0.000
min2846.000-2699.000=147.000
max2846.000-2699.000=147.000
mean2.951-3.033=-0.082
σ0.311-0.037=0.274
min2.470-3.003=-0.533
max3.339-3.094=0.245
iters=5
new-facts=6402
prior-facts=1
mean4752.864-4753.128=-0.265
σ1.139-0.887=0.252
min4751.514-4752.330=-0.816
max4754.647-4754.654=-0.007
mean2846.000-2699.000=147.000
σ0.000
min2846.000-2699.000=147.000
max2846.000-2699.000=147.000
mean8.220-7.898=0.323
σ0.684-0.285=0.400
min7.687-7.690=-0.002
max9.289-8.399=0.891
iters=5
new-facts=6402
prior-facts=6402
mean4943.628-4943.628=0.001
σ0.021-0.022=-0.001
min4943.608-4943.605=0.002
max4943.658-4943.658=0.001
mean3074.400-3022.000=52.400
σ299.757-368.347=-68.590
min2846.000-2699.000=147.000
max3535.000-3556.000=-21.000
mean8.423-8.621=-0.198
σ0.114-0.203=-0.089
min8.313-8.390=-0.077
max8.571-8.866=-0.295

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.155-1.179=-0.024
σ0.267-0.255=0.012
min0.927-0.939=-0.012
max1.534-1.553=-0.019

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.085-473.082=0.003
σ575.926-575.931=-0.005
min185.113-185.111=0.001
max1336.973-1336.978=-0.004
mean88.250
σ8.500
min84.000
max101.000
mean2846.000-2699.000=147.000
σ0.000
min2846.000-2699.000=147.000
max2846.000-2699.000=147.000
mean0.451-0.566=-0.115
σ0.299-0.550=-0.250
min0.300-0.286=0.014
max0.900-1.391=-0.491
policies=20
mean1851.465-1851.433=0.032
σ0.377-0.365=0.012
min1851.181-1851.184=-0.003
max1852.012-1851.972=0.040
mean840.000
σ0.000
min840.000
max840.000
mean2846.000-2699.000=147.000
σ0.000
min2846.000-2699.000=147.000
max2846.000-2699.000=147.000
mean2.951-2.870=0.080
σ0.010-0.020=-0.010
min2.936-2.849=0.087
max2.958-2.894=0.064
policies=200
mean18521.074-18521.160=-0.086
σ0.471-0.511=-0.039
min18520.721-18520.897=-0.176
max18521.747-18521.926=-0.179
mean8400.000
σ0.000
min8400.000
max8400.000
mean2846.000-2699.000=147.000
σ0.000
min2846.000-2699.000=147.000
max2846.000-2699.000=147.000
mean29.200-28.908=0.292
σ0.473-0.034=0.439
min28.758-28.863=-0.106
max29.823-28.936=0.887