Compare commits

Home / Compare 93419d5f .. 28a7bc97

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.001
σ0.108-0.108=-0.000
min35.751-35.752=-0.001
max36.105-36.104=0.001
mean416.900-411.000=5.900
σ0.316-0.000=0.316
min416.000-411.000=5.000
max417.000-411.000=6.000
mean0.075-0.074=0.001
σ0.005-0.004=0.000
min0.070-0.069=0.001
max0.083-0.080=0.003
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.001
σ0.004-0.003=0.000
min26.060-26.060=-0.000
max26.070-26.070=0.000
mean417.000-411.000=6.000
σ0.000
min417.000-411.000=6.000
max417.000-411.000=6.000
mean0.061-0.061=0.001
σ0.003-0.002=0.001
min0.060-0.059=0.001
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.922-1755.921=0.001
σ0.366-0.368=-0.002
min1755.353-1755.354=-0.001
max1756.515-1756.509=0.006
mean1669.000-1632.100=36.900
σ635.569-607.034=28.535
min669.000-652.000=17.000
max2633.000-2429.000=204.000
mean2.824-2.804=0.020
σ0.091-0.185=-0.093
min2.622-2.291=0.331
max3.011-3.053=-0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.827-277.196=-2.368
σ0.007-0.004=0.003
min274.818-277.191=-2.373
max274.834-277.200=-2.366
mean2633.000-2429.000=204.000
σ0.000
min2633.000-2429.000=204.000
max2633.000-2429.000=204.000
mean0.391-0.399=-0.008
σ0.010-0.009=0.001
min0.383-0.393=-0.009
max0.404-0.410=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1940.003-2174.432=-234.429
σ0.011-0.027=-0.016
min1939.994-2174.392=-234.398
max1940.018-2174.463=-234.445
mean2633.000-2429.000=204.000
σ0.000
min2633.000-2429.000=204.000
max2633.000-2429.000=204.000
mean3.077-2.920=0.158
σ0.098-0.270=-0.172
min2.956-2.691=0.265
max3.190-3.359=-0.169
iters=5
new-facts=6402
prior-facts=1
mean4758.870-5052.612=-293.742
σ0.909-1.028=-0.119
min4758.329-5052.072=-293.742
max4760.484-5054.444=-293.960
mean2633.000-2429.000=204.000
σ0.000
min2633.000-2429.000=204.000
max2633.000-2429.000=204.000
mean8.156-9.148=-0.991
σ0.698-0.687=0.012
min7.670-8.144=-0.474
max9.368-9.996=-0.628
iters=5
new-facts=6402
prior-facts=6402
mean4953.913-5188.422=-234.509
σ0.202-0.093=0.109
min4953.577-5188.351=-234.774
max4954.071-5188.529=-234.458
mean2982.400-3192.200=-209.800
σ377.836-485.079=-107.243
min2633.000-2604.000=29.000
max3520.000-3837.000=-317.000
mean8.471-8.894=-0.423
σ0.162-0.210=-0.048
min8.371-8.669=-0.298
max8.754-9.128=-0.374

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.344-1.804=-0.460
σ0.344-0.106=0.238
min0.961-1.666=-0.704
max1.762-1.946=-0.184

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.855-464.844=0.011
σ572.658-572.646=0.012
min178.523-178.520=0.003
max1323.842-1323.812=0.030
mean79.500
σ7.000
min76.000
max90.000
mean2633.000-2429.000=204.000
σ0.000
min2633.000-2429.000=204.000
max2633.000-2429.000=204.000
mean0.565-0.559=0.006
σ0.556-0.557=-0.001
min0.282-0.279=0.003
max1.399-1.395=0.004
policies=20
mean1785.483-1785.456=0.027
σ0.350-0.349=0.001
min1785.261-1785.227=0.034
max1786.003-1785.975=0.029
mean760.000
σ0.000
min760.000
max760.000
mean2633.000-2429.000=204.000
σ0.000
min2633.000-2429.000=204.000
max2633.000-2429.000=204.000
mean2.783-2.789=-0.007
σ0.015-0.013=0.002
min2.774-2.769=0.005
max2.806-2.797=0.009
policies=200
mean17861.531-17861.406=0.124
σ0.515-0.408=0.107
min17861.242-17861.124=0.118
max17862.302-17862.011=0.291
mean7600.000
σ0.000
min7600.000
max7600.000
mean2633.000-2429.000=204.000
σ0.000
min2633.000-2429.000=204.000
max2633.000-2429.000=204.000
mean28.158-28.114=0.044
σ0.158-0.067=0.091
min27.999-28.050=-0.051
max28.324-28.180=0.144