Compare commits

Home / Compare 0fcc2eeb .. 26c24788

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.733-70.732=0.002
σ0.045-0.046=-0.001
min70.702-70.703=-0.001
max70.858-70.858=0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.160-0.159=0.001
σ0.003-0.004=-0.001
min0.157-0.156=0.001
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.445-21.446=-0.000
σ0.002-0.003=-0.000
min21.440-21.443=-0.002
max21.448-21.451=-0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.000
min0.064-0.063=0.000
max0.074-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.910-1757.907=0.003
σ0.359-0.358=0.001
min1757.343-1757.335=0.009
max1758.496-1758.463=0.033
mean1657.850-1670.850=-13.000
σ640.532-654.247=-13.715
min680.000-644.000=36.000
max2791.000-2869.000=-78.000
mean2.853-2.827=0.025
σ0.165-0.141=0.024
min2.507-2.467=0.039
max3.123-3.133=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.390-275.390=0.001
σ0.005-0.005=0.000
min275.382-275.383=-0.001
max275.395-275.394=0.001
mean2791.000-2869.000=-78.000
σ0.000
min2791.000-2869.000=-78.000
max2791.000-2869.000=-78.000
mean0.400-0.387=0.013
σ0.009-0.005=0.004
min0.386-0.383=0.003
max0.407-0.395=0.012
iters=5
new-facts=1
prior-facts=6402
mean1935.784-1935.768=0.015
σ0.004-0.015=-0.011
min1935.778-1935.752=0.027
max1935.788-1935.786=0.002
mean2791.000-2869.000=-78.000
σ0.000
min2791.000-2869.000=-78.000
max2791.000-2869.000=-78.000
mean3.118-3.018=0.100
σ0.195-0.057=0.137
min2.970-2.952=0.018
max3.452-3.108=0.343
iters=5
new-facts=6402
prior-facts=1
mean4756.401-4756.513=-0.111
σ0.964-0.878=0.086
min4755.533-4755.998=-0.465
max4758.057-4758.077=-0.021
mean2791.000-2869.000=-78.000
σ0.000
min2791.000-2869.000=-78.000
max2791.000-2869.000=-78.000
mean8.702-8.749=-0.047
σ0.218-0.252=-0.033
min8.339-8.499=-0.160
max8.917-9.163=-0.245
iters=5
new-facts=6402
prior-facts=6402
mean4947.013-4946.941=0.072
σ0.012-0.148=-0.136
min4946.997-4946.678=0.318
max4947.026-4947.033=-0.006
mean3073.600-3034.600=39.000
σ289.911-191.512=98.399
min2791.000-2869.000=-78.000
max3370.000-3337.000=33.000
mean8.817-8.567=0.250
σ0.291-0.097=0.194
min8.489-8.435=0.054
max9.211-8.697=0.514

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.985-1.017=-0.031
σ0.150-0.123=0.027
min0.909-0.935=-0.025
max1.254-1.211=0.042

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean478.089-478.086=0.003
σ574.928-574.925=0.003
min190.617-190.609=0.009
max1340.481-1340.473=0.008
mean90.250
σ8.500
min86.000
max103.000
mean2791.000-2869.000=-78.000
σ0.000
min2791.000-2869.000=-78.000
max2791.000-2869.000=-78.000
mean0.502-0.436=0.066
σ0.400-0.258=0.142
min0.295-0.285=0.010
max1.102-0.822=0.280
policies=20
mean1906.449-1906.467=-0.018
σ0.373-0.383=-0.010
min1906.199-1906.168=0.031
max1906.993-1907.009=-0.015
mean860.000
σ0.000
min860.000
max860.000
mean2791.000-2869.000=-78.000
σ0.000
min2791.000-2869.000=-78.000
max2791.000-2869.000=-78.000
mean2.961-3.056=-0.095
σ0.010-0.014=-0.004
min2.952-3.036=-0.084
max2.972-3.068=-0.096
policies=200
mean19070.921-19071.103=-0.182
σ0.622-0.468=0.154
min19070.543-19070.700=-0.157
max19071.846-19071.779=0.068
mean8600.000
σ0.000
min8600.000
max8600.000
mean2791.000-2869.000=-78.000
σ0.000
min2791.000-2869.000=-78.000
max2791.000-2869.000=-78.000
mean29.935-30.108=-0.173
σ0.030-0.500=-0.470
min29.897-29.809=0.088
max29.970-30.851=-0.882