Compare commits

Home / Compare 2b49fe6d .. 51bfafae

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.787-70.786=0.001
σ0.045-0.047=-0.002
min70.756-70.753=0.003
max70.912-70.915=-0.004
mean412.400-415.800=-3.400
σ0.516-0.422=0.095
min412.000-415.000=-3.000
max413.000-416.000=-3.000
mean0.159-0.158=0.001
σ0.004-0.003=0.001
min0.149-0.155=-0.006
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.496-21.496=0.000
σ0.002-0.002=-0.000
min21.493-21.492=0.000
max21.500-21.499=0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.065-0.065=0.000
σ0.002-0.003=-0.000
min0.063-0.063=0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.095=-0.003
σ0.362-0.362=-0.001
min1753.525-1753.530=-0.005
max1754.679-1754.687=-0.008
mean1634.500-1638.450=-3.950
σ611.818-618.126=-6.309
min643.000-640.000=3.000
max2456.000-2476.000=-20.000
mean2.766-2.742=0.024
σ0.174-0.226=-0.052
min2.299-2.152=0.147
max3.095-2.972=0.123

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.924-271.954=-0.030
σ0.008-0.006=0.001
min271.917-271.946=-0.029
max271.936-271.961=-0.026
mean2456.000-2476.000=-20.000
σ0.000
min2456.000-2476.000=-20.000
max2456.000-2476.000=-20.000
mean0.385-0.381=0.004
σ0.011-0.002=0.009
min0.379-0.378=0.001
max0.405-0.384=0.021
iters=5
new-facts=1
prior-facts=6402
mean1932.326-1932.323=0.003
σ0.005-0.015=-0.009
min1932.321-1932.299=0.022
max1932.335-1932.338=-0.003
mean2456.000-2476.000=-20.000
σ0.000
min2456.000-2476.000=-20.000
max2456.000-2476.000=-20.000
mean3.002-3.022=-0.020
σ0.108-0.167=-0.059
min2.866-2.763=0.103
max3.166-3.219=-0.053
iters=5
new-facts=6402
prior-facts=1
mean4753.138-4753.048=0.090
σ0.850-0.929=-0.078
min4752.633-4752.568=0.065
max4754.652-4754.704=-0.052
mean2456.000-2476.000=-20.000
σ0.000
min2456.000-2476.000=-20.000
max2456.000-2476.000=-20.000
mean8.313-8.751=-0.438
σ0.502-0.480=0.022
min7.592-7.986=-0.394
max8.877-9.103=-0.226
iters=5
new-facts=6402
prior-facts=6402
mean4943.483-4943.414=0.068
σ0.167-0.191=-0.024
min4943.187-4943.188=-0.001
max4943.585-4943.576=0.009
mean2993.600-2915.200=78.400
σ287.351-323.537=-36.186
min2597.000-2476.000=121.000
max3334.000-3351.000=-17.000
mean8.487-8.404=0.082
σ0.110-0.073=0.037
min8.345-8.325=0.020
max8.642-8.492=0.150

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.727-1.851=-0.124
σ0.198-0.063=0.135
min1.491-1.772=-0.281
max1.976-1.928=0.048

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.658-468.656=0.002
σ574.926-574.928=-0.002
min181.190-181.191=-0.001
max1331.048-1331.049=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2456.000-2476.000=-20.000
σ0.000
min2456.000-2476.000=-20.000
max2456.000-2476.000=-20.000
mean0.575-0.566=0.009
σ0.574-0.544=0.030
min0.284-0.280=0.004
max1.436-1.382=0.054
policies=20
mean1812.217-1812.214=0.003
σ0.394-0.393=0.001
min1811.954-1811.957=-0.003
max1812.800-1812.795=0.004
mean840.000
σ0.000
min840.000
max840.000
mean2456.000-2476.000=-20.000
σ0.000
min2456.000-2476.000=-20.000
max2456.000-2476.000=-20.000
mean2.846-2.839=0.007
σ0.013-0.017=-0.004
min2.832-2.813=0.018
max2.863-2.850=0.014
policies=200
mean18129.359-18129.243=0.116
σ0.492-0.336=0.156
min18129.092-18129.061=0.032
max18130.096-18129.747=0.349
mean8400.000
σ0.000
min8400.000
max8400.000
mean2456.000-2476.000=-20.000
σ0.000
min2456.000-2476.000=-20.000
max2456.000-2476.000=-20.000
mean28.651-28.592=0.059
σ0.110-0.090=0.020
min28.543-28.485=0.058
max28.787-28.688=0.099