Compare commits

Home / Compare c0fa2c99 .. 44aae63b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.799=-0.000
σ0.107-0.108=-0.001
min35.750-35.753=-0.002
max36.101-36.105=-0.004
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.074-0.073=0.000
σ0.004-0.004=-0.001
min0.069-0.068=0.001
max0.080-0.080=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.001
σ0.004-0.002=0.002
min26.059-26.062=-0.003
max26.071-26.069=0.002
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.060-0.061=-0.000
σ0.004-0.003=0.001
min0.057-0.059=-0.001
max0.067-0.068=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.921=0.003
σ0.366-0.370=-0.004
min1755.344-1755.352=-0.008
max1756.520-1756.518=0.002
mean1644.350-1666.200=-21.850
σ623.792-630.062=-6.271
min609.000-665.000=-56.000
max2649.000-2621.000=28.000
mean2.817-2.819=-0.002
σ0.177-0.180=-0.003
min2.304-2.290=0.014
max3.049-3.111=-0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.197-277.193=0.004
σ0.005-0.004=0.001
min277.192-277.190=0.002
max277.203-277.197=0.006
mean2649.000-2621.000=28.000
σ0.000
min2649.000-2621.000=28.000
max2649.000-2621.000=28.000
mean0.394-0.396=-0.002
σ0.002-0.004=-0.002
min0.392-0.393=-0.000
max0.397-0.403=-0.006
iters=5
new-facts=1
prior-facts=6402
mean2174.420-2174.432=-0.012
σ0.031-0.012=0.019
min2174.369-2174.415=-0.046
max2174.450-2174.449=0.001
mean2649.000-2621.000=28.000
σ0.000
min2649.000-2621.000=28.000
max2649.000-2621.000=28.000
mean3.001-3.050=-0.049
σ0.126-0.225=-0.099
min2.793-2.830=-0.037
max3.124-3.333=-0.209
iters=5
new-facts=6402
prior-facts=1
mean5052.479-5052.580=-0.100
σ1.041-0.970=0.071
min5051.719-5052.020=-0.301
max5054.311-5054.305=0.007
mean2649.000-2621.000=28.000
σ0.000
min2649.000-2621.000=28.000
max2649.000-2621.000=28.000
mean9.090-9.005=0.084
σ0.432-0.328=0.104
min8.638-8.538=0.099
max9.686-9.336=0.350
iters=5
new-facts=6402
prior-facts=6402
mean5188.291-5188.422=-0.130
σ0.202-0.095=0.107
min5188.005-5188.335=-0.329
max5188.520-5188.525=-0.004
mean3222.200-3269.800=-47.600
σ381.692-386.731=-5.039
min2687.000-2729.000=-42.000
max3699.000-3741.000=-42.000
mean8.994-9.225=-0.231
σ0.429-0.531=-0.102
min8.690-8.729=-0.038
max9.740-9.795=-0.055

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.198-1.307=-0.109
σ0.205-0.332=-0.128
min1.053-0.940=0.112
max1.535-1.783=-0.248

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.850-464.856=-0.005
σ572.661-572.660=0.000
min178.516-178.520=-0.004
max1323.841-1323.846=-0.005
mean79.500
σ7.000
min76.000
max90.000
mean2649.000-2621.000=28.000
σ0.000
min2649.000-2621.000=28.000
max2649.000-2621.000=28.000
mean0.561-0.549=0.013
σ0.564-0.534=0.030
min0.271-0.279=-0.008
max1.408-1.350=0.058
policies=20
mean1785.473-1785.488=-0.015
σ0.356-0.347=0.008
min1785.238-1785.259=-0.021
max1786.001-1786.004=-0.003
mean760.000
σ0.000
min760.000
max760.000
mean2649.000-2621.000=28.000
σ0.000
min2649.000-2621.000=28.000
max2649.000-2621.000=28.000
mean2.790-2.807=-0.017
σ0.010-0.004=0.005
min2.779-2.801=-0.022
max2.800-2.811=-0.011
policies=200
mean17861.422-17861.430=-0.008
σ0.440-0.617=-0.177
min17861.080-17861.094=-0.013
max17862.064-17862.355=-0.291
mean7600.000
σ0.000
min7600.000
max7600.000
mean2649.000-2621.000=28.000
σ0.000
min2649.000-2621.000=28.000
max2649.000-2621.000=28.000
mean28.241-28.358=-0.117
σ0.121-0.208=-0.087
min28.145-28.147=-0.002
max28.398-28.636=-0.238