Compare commits

Home / Compare 927d0dce .. 42c590b9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.048-0.049=-0.001
min33.947-33.946=0.001
max34.109-34.113=-0.004
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.082-0.085=-0.003
σ0.005-0.003=0.001
min0.076-0.083=-0.007
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.000
σ0.003-0.004=-0.000
min23.314-23.314=-0.000
max23.322-23.325=-0.003
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.065-0.065=-0.000
σ0.002-0.002=-0.000
min0.064-0.064=-0.000
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.493=0.001
σ0.366-0.363=0.003
min1756.920-1756.922=-0.002
max1758.085-1758.083=0.003
mean1662.450-1674.750=-12.300
σ650.031-636.122=13.909
min653.000-663.000=-10.000
max2825.000-2643.000=182.000
mean2.362-2.369=-0.008
σ0.111-0.105=0.006
min2.170-2.256=-0.086
max2.679-2.706=-0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.640-326.632=0.008
σ0.044-0.056=-0.012
min326.563-326.533=0.030
max326.666-326.666=-0.001
mean2825.000-2643.000=182.000
σ0.000
min2825.000-2643.000=182.000
max2825.000-2643.000=182.000
mean0.424-0.429=-0.005
σ0.001-0.006=-0.004
min0.422-0.424=-0.002
max0.426-0.435=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1988.804-1988.806=-0.002
σ0.003-0.009=-0.006
min1988.801-1988.796=0.004
max1988.807-1988.816=-0.009
mean2825.000-2643.000=182.000
σ0.000
min2825.000-2643.000=182.000
max2825.000-2643.000=182.000
mean2.728-2.722=0.006
σ0.117-0.138=-0.021
min2.623-2.570=0.053
max2.876-2.921=-0.045
iters=5
new-facts=6402
prior-facts=1
mean4813.644-4813.459=0.185
σ7.726-7.561=0.165
min4810.139-4809.668=0.471
max4827.464-4826.977=0.487
mean2825.000-2643.000=182.000
σ0.000
min2825.000-2643.000=182.000
max2825.000-2643.000=182.000
mean8.834-8.522=0.312
σ0.299-0.606=-0.308
min8.392-7.983=0.409
max9.152-9.516=-0.364
iters=5
new-facts=6402
prior-facts=6402
mean5001.055-5001.200=-0.144
σ0.330-0.032=0.298
min5000.468-5001.152=-0.684
max5001.246-5001.228=0.018
mean3057.600-2992.000=65.600
σ246.150-389.460=-143.310
min2825.000-2643.000=182.000
max3416.000-3549.000=-133.000
mean9.592-9.522=0.071
σ0.622-0.614=0.008
min8.497-8.441=0.056
max10.017-9.979=0.038

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.192=-0.172
σ0.126-0.349=-0.223
min0.906-0.933=-0.027
max1.217-1.801=-0.584

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.629-464.628=0.001
σ574.773-574.778=-0.005
min177.239-177.232=0.007
max1326.789-1326.796=-0.007
mean88.250
σ8.500
min84.000
max101.000
mean2825.000-2643.000=182.000
σ0.000
min2825.000-2643.000=182.000
max2825.000-2643.000=182.000
mean0.435-0.552=-0.117
σ0.307-0.551=-0.244
min0.279-0.275=0.004
max0.896-1.379=-0.484
policies=20
mean1772.724-1772.660=0.064
σ0.367-0.355=0.012
min1772.473-1772.425=0.048
max1773.267-1773.187=0.080
mean840.000
σ0.000
min840.000
max840.000
mean2825.000-2643.000=182.000
σ0.000
min2825.000-2643.000=182.000
max2825.000-2643.000=182.000
mean2.802-2.730=0.072
σ0.012-0.008=0.004
min2.793-2.723=0.070
max2.819-2.741=0.078
policies=200
mean17733.991-17734.011=-0.019
σ0.575-0.507=0.068
min17733.569-17733.648=-0.079
max17734.833-17734.761=0.072
mean8400.000
σ0.000
min8400.000
max8400.000
mean2825.000-2643.000=182.000
σ0.000
min2825.000-2643.000=182.000
max2825.000-2643.000=182.000
mean27.918-27.582=0.337
σ0.442-0.152=0.290
min27.408-27.435=-0.028
max28.358-27.717=0.641