Compare commits

Home / Compare 2c176af0 .. 8272c56e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.727-70.730=-0.002
σ0.047-0.046=0.001
min70.699-70.701=-0.002
max70.858-70.859=-0.001
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.152-0.161=-0.008
σ0.019-0.003=0.016
min0.102-0.157=-0.055
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.446-21.445=0.000
σ0.003-0.003=0.000
min21.441-21.442=-0.001
max21.450-21.450=0.000
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.064-0.065=-0.001
σ0.003-0.003=0.000
min0.060-0.061=-0.001
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.528-1754.527=0.001
σ0.361-0.361=-0.000
min1753.957-1753.956=0.002
max1755.111-1755.111=-0.000
mean1652.800-1659.550=-6.750
σ633.422-639.846=-6.424
min638.000-622.000=16.000
max2847.000-2836.000=11.000
mean2.843-2.844=-0.001
σ0.147-0.117=0.029
min2.523-2.616=-0.093
max3.128-3.027=0.101

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.607-273.609=-0.002
σ0.007-0.007=-0.000
min273.598-273.600=-0.002
max273.617-273.616=0.001
mean2847.000-2836.000=11.000
σ0.000
min2847.000-2836.000=11.000
max2847.000-2836.000=11.000
mean0.381-0.386=-0.005
σ0.002-0.008=-0.006
min0.379-0.382=-0.003
max0.384-0.401=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1934.006-1934.002=0.004
σ0.015-0.007=0.008
min1933.989-1933.996=-0.007
max1934.026-1934.013=0.014
mean2847.000-2836.000=11.000
σ0.000
min2847.000-2836.000=11.000
max2847.000-2836.000=11.000
mean2.854-3.158=-0.305
σ0.287-0.159=0.128
min2.392-2.988=-0.596
max3.080-3.348=-0.267
iters=5
new-facts=6402
prior-facts=1
mean4754.543-4754.730=-0.187
σ0.723-0.848=-0.125
min4753.825-4754.280=-0.455
max4755.754-4756.244=-0.489
mean2847.000-2836.000=11.000
σ0.000
min2847.000-2836.000=11.000
max2847.000-2836.000=11.000
mean8.515-8.570=-0.055
σ0.466-0.440=0.026
min7.792-7.845=-0.054
max8.916-8.930=-0.014
iters=5
new-facts=6402
prior-facts=6402
mean4945.226-4945.226=-0.000
σ0.017-0.016=0.001
min4945.208-4945.209=-0.001
max4945.246-4945.240=0.007
mean3048.600-3066.600=-18.000
σ199.085-247.107=-48.022
min2847.000-2836.000=11.000
max3307.000-3326.000=-19.000
mean8.604-9.007=-0.403
σ0.190-0.467=-0.277
min8.384-8.506=-0.121
max8.814-9.609=-0.794

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.061=-0.033
σ0.140-0.132=0.008
min0.935-0.939=-0.004
max1.256-1.265=-0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.845-472.843=0.002
σ574.936-574.931=0.006
min185.365-185.365=0.000
max1335.250-1335.239=0.011
mean88.250
σ8.500
min84.000
max101.000
mean2847.000-2836.000=11.000
σ0.000
min2847.000-2836.000=11.000
max2847.000-2836.000=11.000
mean0.490-0.457=0.033
σ0.380-0.308=0.072
min0.297-0.300=-0.003
max1.060-0.919=0.141
policies=20
mean1854.017-1854.005=0.012
σ0.375-0.383=-0.007
min1853.729-1853.717=0.012
max1854.559-1854.558=0.000
mean840.000
σ0.000
min840.000
max840.000
mean2847.000-2836.000=11.000
σ0.000
min2847.000-2836.000=11.000
max2847.000-2836.000=11.000
mean2.956-2.961=-0.006
σ0.007-0.004=0.003
min2.951-2.958=-0.007
max2.966-2.967=-0.001
policies=200
mean18546.639-18546.759=-0.120
σ0.391-0.447=-0.056
min18546.312-18546.473=-0.162
max18547.200-18547.424=-0.224
mean8400.000
σ0.000
min8400.000
max8400.000
mean2847.000-2836.000=11.000
σ0.000
min2847.000-2836.000=11.000
max2847.000-2836.000=11.000
mean29.167-29.316=-0.149
σ0.459-0.512=-0.053
min28.760-28.804=-0.044
max29.796-29.923=-0.127