Compare commits

Home / Compare 849fad42 .. c4f27b22

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.970-35.964=0.006
σ0.106-0.106=-0.000
min35.921-35.912=0.009
max36.271-36.265=0.006
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.078-0.076=0.002
σ0.005-0.006=-0.001
min0.072-0.063=0.008
max0.086-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean26.205-26.202=0.003
σ0.004-0.003=0.001
min26.201-26.199=0.003
max26.214-26.206=0.007
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.060-0.062=-0.002
σ0.003-0.004=-0.001
min0.057-0.060=-0.002
max0.067-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.378-1756.926=1.451
σ0.369-0.367=0.002
min1757.803-1756.351=1.452
max1758.975-1757.523=1.452
mean1656.550-1660.050=-3.500
σ620.624-641.037=-20.413
min688.000-610.000=78.000
max2745.000-2686.000=59.000
mean2.394-2.364=0.030
σ0.088-0.185=-0.097
min2.305-2.194=0.111
max2.605-3.074=-0.469

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean280.902-279.435=1.467
σ0.006-0.013=-0.006
min280.893-279.418=1.474
max280.910-279.452=1.457
mean2745.000-2686.000=59.000
σ0.000
min2745.000-2686.000=59.000
max2745.000-2686.000=59.000
mean0.418-0.419=-0.001
σ0.008-0.012=-0.004
min0.414-0.409=0.005
max0.431-0.436=-0.005
iters=5
new-facts=1
prior-facts=6402
mean2270.900-2269.506=1.394
σ0.026-0.013=0.013
min2270.862-2269.484=1.377
max2270.929-2269.516=1.413
mean2745.000-2686.000=59.000
σ0.000
min2745.000-2686.000=59.000
max2745.000-2686.000=59.000
mean3.197-2.946=0.251
σ0.351-0.110=0.241
min2.831-2.839=-0.009
max3.738-3.118=0.620
iters=5
new-facts=6402
prior-facts=1
mean5148.202-4954.907=193.294
σ0.984-0.840=0.143
min5147.675-4954.412=193.263
max5149.957-4956.400=193.557
mean2745.000-2686.000=59.000
σ0.000
min2745.000-2686.000=59.000
max2745.000-2686.000=59.000
mean8.638-7.874=0.765
σ0.500-0.175=0.325
min8.151-7.738=0.413
max9.470-8.177=1.293
iters=5
new-facts=6402
prior-facts=6402
mean5286.128-5169.446=116.682
σ0.198-0.090=0.109
min5285.860-5169.348=116.512
max5286.371-5169.526=116.844
mean3451.000-3391.000=60.000
σ436.431-451.453=-15.022
min2829.000-2782.000=47.000
max3977.000-3994.000=-17.000
mean10.125-9.462=0.663
σ0.123-0.106=0.016
min9.913-9.325=0.588
max10.209-9.591=0.618

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.028=-0.028
σ0.140-0.116=0.023
min0.932-0.941=-0.009
max1.249-1.212=0.038

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.550-461.594=3.956
σ572.657-572.656=0.001
min179.198-175.254=3.944
max1324.535-1320.578=3.958
mean79.500-77.500=2.000
σ7.000
min76.000-74.000=2.000
max90.000-88.000=2.000
mean2745.000-2686.000=59.000
σ0.000
min2745.000-2686.000=59.000
max2745.000-2686.000=59.000
mean0.504-0.543=-0.039
σ0.426-0.536=-0.111
min0.278-0.271=0.008
max1.142-1.347=-0.205
policies=20
mean1792.276-1752.805=39.471
σ0.344-0.327=0.017
min1792.036-1752.594=39.442
max1792.784-1753.291=39.492
mean760.000-740.000=20.000
σ0.000
min760.000-740.000=20.000
max760.000-740.000=20.000
mean2745.000-2686.000=59.000
σ0.000
min2745.000-2686.000=59.000
max2745.000-2686.000=59.000
mean2.812-2.709=0.103
σ0.015-0.017=-0.002
min2.798-2.692=0.106
max2.831-2.730=0.100
policies=200
mean17929.557-17534.698=394.859
σ0.505-0.253=0.252
min17929.269-17534.402=394.867
max17930.312-17535.019=395.293
mean7600.000-7400.000=200.000
σ0.000
min7600.000-7400.000=200.000
max7600.000-7400.000=200.000
mean2745.000-2686.000=59.000
σ0.000
min2745.000-2686.000=59.000
max2745.000-2686.000=59.000
mean28.382-27.329=1.053
σ0.152-0.083=0.069
min28.163-27.217=0.947
max28.506-27.400=1.106