Compare commits

Home / Compare 67318205 .. 2e584c96

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.684-70.566=0.118
σ0.044-0.045=-0.000
min70.658-70.540=0.118
max70.808-70.689=0.119
mean410.000-414.000=-4.000
σ0.000
min410.000-414.000=-4.000
max410.000-414.000=-4.000
mean0.160-0.161=-0.001
σ0.003-0.004=-0.001
min0.157-0.157=-0.001
max0.165-0.167=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.420-21.288=0.133
σ0.003-0.003=0.000
min21.416-21.283=0.133
max21.424-21.291=0.134
mean410.000-414.000=-4.000
σ0.000
min410.000-414.000=-4.000
max410.000-414.000=-4.000
mean0.063-0.065=-0.002
σ0.003-0.003=0.000
min0.059-0.063=-0.004
max0.069-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1753.567=0.891
σ0.359-0.360=-0.001
min1753.889-1752.991=0.898
max1755.033-1754.150=0.882
mean1648.200-1646.900=1.300
σ640.716-639.231=1.485
min648.000-628.000=20.000
max2871.000-2876.000=-5.000
mean2.825-2.810=0.014
σ0.131-0.156=-0.025
min2.556-2.418=0.138
max3.053-3.030=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.505-272.017=1.488
σ0.008-0.008=-0.000
min273.497-272.009=1.488
max273.519-272.030=1.489
mean2871.000-2876.000=-5.000
σ0.000
min2871.000-2876.000=-5.000
max2871.000-2876.000=-5.000
mean0.387-0.391=-0.004
σ0.003-0.009=-0.006
min0.385-0.379=0.006
max0.392-0.402=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1933.897-1932.439=1.457
σ0.009-0.011=-0.002
min1933.886-1932.421=1.465
max1933.906-1932.450=1.457
mean2871.000-2876.000=-5.000
σ0.000
min2871.000-2876.000=-5.000
max2871.000-2876.000=-5.000
mean3.002-2.944=0.058
σ0.147-0.140=0.007
min2.787-2.796=-0.010
max3.188-3.121=0.067
iters=5
new-facts=6402
prior-facts=1
mean4754.739-4753.192=1.547
σ0.792-0.804=-0.013
min4754.335-4752.749=1.586
max4756.154-4754.626=1.528
mean2871.000-2876.000=-5.000
σ0.000
min2871.000-2876.000=-5.000
max2871.000-2876.000=-5.000
mean7.980-8.375=-0.395
σ0.256-0.412=-0.155
min7.839-7.716=0.123
max8.435-8.728=-0.294
iters=5
new-facts=6402
prior-facts=6402
mean4945.112-4943.565=1.547
σ0.014-0.167=-0.153
min4945.090-4943.267=1.822
max4945.124-4943.659=1.466
mean3041.600-3055.000=-13.400
σ253.416-188.258=65.158
min2871.000-2876.000=-5.000
max3449.000-3327.000=122.000
mean8.432-8.791=-0.359
σ0.069-0.382=-0.313
min8.327-8.452=-0.125
max8.498-9.367=-0.870

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.077-1.032=0.046
σ0.238-0.140=0.098
min0.936-0.940=-0.004
max1.488-1.260=0.229

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.574-473.076=-0.502
σ574.939-575.916=-0.977
min185.093-185.109=-0.016
max1334.983-1336.950=-1.967
mean88.250
σ8.500
min84.000
max101.000
mean2871.000-2876.000=-5.000
σ0.000
min2871.000-2876.000=-5.000
max2871.000-2876.000=-5.000
mean0.450-0.487=-0.036
σ0.312-0.381=-0.069
min0.280-0.277=0.003
max0.918-1.058=-0.140
policies=20
mean1851.271-1851.428=-0.157
σ0.378-0.374=0.004
min1850.988-1851.141=-0.154
max1851.822-1851.970=-0.149
mean840.000
σ0.000
min840.000
max840.000
mean2871.000-2876.000=-5.000
σ0.000
min2871.000-2876.000=-5.000
max2871.000-2876.000=-5.000
mean2.954-2.972=-0.018
σ0.011-0.021=-0.010
min2.940-2.948=-0.009
max2.966-2.994=-0.028
policies=200
mean18519.474-18520.893=-1.419
σ0.489-0.465=0.025
min18519.183-18520.631=-1.448
max18520.207-18521.587=-1.381
mean8400.000
σ0.000
min8400.000
max8400.000
mean2871.000-2876.000=-5.000
σ0.000
min2871.000-2876.000=-5.000
max2871.000-2876.000=-5.000
mean29.253-29.236=0.017
σ0.405-0.397=0.008
min28.954-28.777=0.178
max29.820-29.745=0.075