Compare commits

Home / Compare ff5bb89e .. 056d550c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.711-70.712=-0.001
σ0.047-0.046=0.002
min70.677-70.674=0.003
max70.843-70.836=0.006
mean413.200-411.600=1.600
σ0.422-0.516=-0.095
min413.000-411.000=2.000
max414.000-412.000=2.000
mean0.157-0.158=-0.001
σ0.005-0.006=-0.001
min0.151-0.151=0.000
max0.163-0.166=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.415-21.414=0.000
σ0.003-0.003=0.000
min21.410-21.411=-0.000
max21.420-21.420=-0.000
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.064-0.065=-0.001
σ0.002-0.003=-0.000
min0.059-0.063=-0.004
max0.068-0.072=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.935-1754.933=0.002
σ0.361-0.361=-0.001
min1754.363-1754.366=-0.003
max1755.517-1755.523=-0.006
mean1646.950-1657.950=-11.000
σ623.204-646.011=-22.807
min624.000-621.000=3.000
max2769.000-2774.000=-5.000
mean2.759-2.790=-0.030
σ0.259-0.226=0.033
min2.136-2.276=-0.140
max3.154-3.031=0.124

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.795-272.794=0.001
σ0.010-0.007=0.003
min272.782-272.783=-0.002
max272.808-272.800=0.007
mean2769.000-2774.000=-5.000
σ0.000
min2769.000-2774.000=-5.000
max2769.000-2774.000=-5.000
mean0.383-0.381=0.003
σ0.009-0.001=0.008
min0.377-0.379=-0.003
max0.399-0.381=0.018
iters=5
new-facts=1
prior-facts=6402
mean1933.229-1933.221=0.008
σ0.017-0.020=-0.004
min1933.206-1933.195=0.012
max1933.249-1933.250=-0.001
mean2769.000-2774.000=-5.000
σ0.000
min2769.000-2774.000=-5.000
max2769.000-2774.000=-5.000
mean2.883-3.046=-0.163
σ0.229-0.043=0.186
min2.534-3.011=-0.476
max3.104-3.121=-0.017
iters=5
new-facts=6402
prior-facts=1
mean4757.011-4756.808=0.203
σ7.561-7.674=-0.113
min4753.505-4752.926=0.579
max4770.535-4770.527=0.008
mean2769.000-2774.000=-5.000
σ0.000
min2769.000-2774.000=-5.000
max2769.000-2774.000=-5.000
mean8.312-8.817=-0.505
σ0.489-0.298=0.190
min7.607-8.432=-0.825
max8.807-9.085=-0.278
iters=5
new-facts=6402
prior-facts=6402
mean4944.386-4944.389=-0.003
σ0.150-0.156=-0.006
min4944.118-4944.111=0.007
max4944.465-4944.472=-0.006
mean3047.000-2987.800=59.200
σ269.414-265.349=4.065
min2769.000-2774.000=-5.000
max3419.000-3395.000=24.000
mean8.556-8.460=0.095
σ0.191-0.104=0.087
min8.383-8.373=0.010
max8.847-8.624=0.223

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.015-1.045=-0.030
σ0.158-0.126=0.032
min0.914-0.929=-0.014
max1.279-1.237=0.042

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.332-468.329=0.003
σ574.225-574.228=-0.004
min181.212-181.207=0.005
max1329.669-1329.672=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2769.000-2774.000=-5.000
σ0.000
min2769.000-2774.000=-5.000
max2769.000-2774.000=-5.000
mean0.442-0.445=-0.003
σ0.303-0.304=-0.002
min0.286-0.290=-0.004
max0.896-0.901=-0.005
policies=20
mean1812.392-1812.398=-0.006
σ0.393-0.395=-0.002
min1812.122-1812.127=-0.005
max1812.972-1812.980=-0.008
mean840.000
σ0.000
min840.000
max840.000
mean2769.000-2774.000=-5.000
σ0.000
min2769.000-2774.000=-5.000
max2769.000-2774.000=-5.000
mean2.879-2.890=-0.012
σ0.007-0.016=-0.009
min2.872-2.878=-0.006
max2.887-2.912=-0.025
policies=200
mean18129.182-18129.231=-0.049
σ0.614-0.588=0.026
min18128.739-18128.724=0.015
max18130.079-18130.062=0.017
mean8400.000
σ0.000
min8400.000
max8400.000
mean2769.000-2774.000=-5.000
σ0.000
min2769.000-2774.000=-5.000
max2769.000-2774.000=-5.000
mean28.513-28.523=-0.010
σ0.302-0.250=0.052
min28.230-28.331=-0.101
max28.881-28.882=-0.001