Compare commits

Home / Compare 585070cd .. c140bf55

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.786-70.787=-0.001
σ0.047-0.045=0.002
min70.753-70.756=-0.003
max70.915-70.913=0.002
mean415.800-414.000=1.800
σ0.422-0.000=0.422
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.158-0.161=-0.003
σ0.003-0.003=0.000
min0.155-0.158=-0.004
max0.164-0.168=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.496-21.496=-0.000
σ0.002-0.003=-0.001
min21.492-21.490=0.002
max21.499-21.500=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.063=0.002
σ0.003-0.003=-0.000
min0.063-0.059=0.004
max0.073-0.067=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1754.093=0.002
σ0.362-0.360=0.002
min1753.530-1753.520=0.010
max1754.687-1754.685=0.002
mean1638.450-1667.000=-28.550
σ618.126-637.576=-19.449
min640.000-683.000=-43.000
max2476.000-2728.000=-252.000
mean2.742-2.791=-0.050
σ0.226-0.159=0.068
min2.152-2.444=-0.292
max2.972-3.016=-0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.954-271.953=0.001
σ0.006-0.009=-0.002
min271.946-271.944=0.003
max271.961-271.965=-0.004
mean2476.000-2728.000=-252.000
σ0.000
min2476.000-2728.000=-252.000
max2476.000-2728.000=-252.000
mean0.381-0.383=-0.002
σ0.002-0.008=-0.006
min0.378-0.378=0.001
max0.384-0.398=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1932.323-1932.331=-0.008
σ0.015-0.005=0.010
min1932.299-1932.326=-0.027
max1932.338-1932.337=0.001
mean2476.000-2728.000=-252.000
σ0.000
min2476.000-2728.000=-252.000
max2476.000-2728.000=-252.000
mean3.022-2.972=0.049
σ0.167-0.144=0.024
min2.763-2.734=0.029
max3.219-3.125=0.094
iters=5
new-facts=6402
prior-facts=1
mean4753.048-4753.056=-0.008
σ0.929-0.907=0.022
min4752.568-4752.531=0.037
max4754.704-4754.673=0.032
mean2476.000-2728.000=-252.000
σ0.000
min2476.000-2728.000=-252.000
max2476.000-2728.000=-252.000
mean8.751-8.686=0.065
σ0.480-0.510=-0.030
min7.986-7.873=0.112
max9.103-9.195=-0.091
iters=5
new-facts=6402
prior-facts=6402
mean4943.414-4943.486=-0.071
σ0.191-0.162=0.029
min4943.188-4943.197=-0.009
max4943.576-4943.574=0.002
mean2915.200-2980.600=-65.400
σ323.537-226.886=96.651
min2476.000-2728.000=-252.000
max3351.000-3307.000=44.000
mean8.404-8.486=-0.081
σ0.073-0.129=-0.057
min8.325-8.364=-0.040
max8.492-8.699=-0.208

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.851-1.052=0.799
σ0.063-0.135=-0.073
min1.772-0.929=0.843
max1.928-1.261=0.667

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.656-468.664=-0.007
σ574.928-574.938=-0.010
min181.191-181.186=0.005
max1331.049-1331.070=-0.022
mean88.250
σ8.500
min84.000
max101.000
mean2476.000-2728.000=-252.000
σ0.000
min2476.000-2728.000=-252.000
max2476.000-2728.000=-252.000
mean0.566-0.584=-0.018
σ0.544-0.586=-0.042
min0.280-0.283=-0.003
max1.382-1.463=-0.081
policies=20
mean1812.214-1812.192=0.022
σ0.393-0.384=0.009
min1811.957-1811.927=0.030
max1812.795-1812.759=0.036
mean840.000
σ0.000
min840.000
max840.000
mean2476.000-2728.000=-252.000
σ0.000
min2476.000-2728.000=-252.000
max2476.000-2728.000=-252.000
mean2.839-2.841=-0.002
σ0.017-0.014=0.003
min2.813-2.825=-0.012
max2.850-2.857=-0.008
policies=200
mean18129.243-18129.122=0.121
σ0.336-0.585=-0.249
min18129.061-18128.783=0.278
max18129.747-18129.995=-0.249
mean8400.000
σ0.000
min8400.000
max8400.000
mean2476.000-2728.000=-252.000
σ0.000
min2476.000-2728.000=-252.000
max2476.000-2728.000=-252.000
mean28.592-28.526=0.066
σ0.090-0.084=0.005
min28.485-28.465=0.020
max28.688-28.649=0.038