Compare commits

Home / Compare 70867159 .. 8bb0a9b6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.696=0.034
σ0.051-0.047=0.004
min70.702-70.672=0.031
max70.873-70.828=0.044
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.160-0.160=-0.000
σ0.006-0.003=0.003
min0.150-0.155=-0.005
max0.170-0.164=0.006
cache=y
dps=1
iters=10
policies=100
mean21.450-21.423=0.027
σ0.011-0.011=0.000
min21.442-21.416=0.026
max21.481-21.454=0.026
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.064-0.064=0.000
σ0.005-0.003=0.002
min0.058-0.058=0.000
max0.074-0.068=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.460=0.067
σ0.359-0.360=-0.001
min1753.963-1753.890=0.073
max1755.112-1755.035=0.077
mean1651.150-1643.800=7.350
σ626.060-628.635=-2.576
min619.000-624.000=-5.000
max2645.000-2858.000=-213.000
mean2.836-2.826=0.010
σ0.168-0.158=0.010
min2.574-2.319=0.255
max3.203-3.028=0.175

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.606-273.506=0.100
σ0.007-0.006=0.001
min273.594-273.501=0.092
max273.614-273.517=0.097
mean2645.000-2858.000=-213.000
σ0.000
min2645.000-2858.000=-213.000
max2645.000-2858.000=-213.000
mean0.383-0.384=-0.000
σ0.007-0.004=0.002
min0.379-0.381=-0.002
max0.395-0.391=0.004
iters=5
new-facts=1
prior-facts=6402
mean1934.008-1933.891=0.117
σ0.007-0.010=-0.003
min1934.000-1933.876=0.124
max1934.015-1933.903=0.113
mean2645.000-2858.000=-213.000
σ0.000
min2645.000-2858.000=-213.000
max2645.000-2858.000=-213.000
mean3.028-2.929=0.099
σ0.138-0.088=0.050
min2.921-2.877=0.044
max3.270-3.085=0.185
iters=5
new-facts=6402
prior-facts=1
mean4754.652-4754.521=0.130
σ0.933-0.649=0.284
min4753.738-4754.142=-0.404
max4756.228-4755.675=0.552
mean2645.000-2858.000=-213.000
σ0.000
min2645.000-2858.000=-213.000
max2645.000-2858.000=-213.000
mean8.440-8.779=-0.339
σ0.520-0.262=0.258
min7.617-8.451=-0.834
max8.894-9.079=-0.185
iters=5
new-facts=6402
prior-facts=6402
mean4945.225-4945.119=0.106
σ0.017-0.017=-0.000
min4945.207-4945.102=0.106
max4945.243-4945.139=0.104
mean3008.200-3022.600=-14.400
σ285.187-187.324=97.863
min2645.000-2858.000=-213.000
max3374.000-3315.000=59.000
mean8.600-8.527=0.073
σ0.238-0.110=0.128
min8.389-8.433=-0.044
max8.979-8.685=0.295

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.257-1.053=0.204
σ0.340-0.128=0.212
min0.934-0.938=-0.004
max1.821-1.254=0.567

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.865-473.100=-0.235
σ574.936-575.909=-0.972
min185.392-185.140=0.252
max1335.270-1336.963=-1.693
mean88.250
σ8.500
min84.000
max101.000
mean2645.000-2858.000=-213.000
σ0.000
min2645.000-2858.000=-213.000
max2645.000-2858.000=-213.000
mean0.576-0.452=0.124
σ0.579-0.306=0.272
min0.284-0.295=-0.011
max1.444-0.911=0.533
policies=20
mean1854.207-1851.696=2.511
σ0.388-0.373=0.015
min1853.937-1851.423=2.514
max1854.779-1852.236=2.544
mean840.000
σ0.000
min840.000
max840.000
mean2645.000-2858.000=-213.000
σ0.000
min2645.000-2858.000=-213.000
max2645.000-2858.000=-213.000
mean2.863-2.951=-0.088
σ0.012-0.008=0.005
min2.848-2.942=-0.094
max2.878-2.959=-0.081
policies=200
mean18548.972-18522.324=26.648
σ0.410-0.764=-0.354
min18548.681-18521.719=26.962
max18549.574-18523.307=26.266
mean8400.000
σ0.000
min8400.000
max8400.000
mean2645.000-2858.000=-213.000
σ0.000
min2645.000-2858.000=-213.000
max2645.000-2858.000=-213.000
mean28.813-29.130=-0.317
σ0.089-0.457=-0.368
min28.682-28.803=-0.122
max28.873-29.788=-0.915