Compare commits

Home / Compare 3753fd7c .. eea006d8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.799=-0.001
σ0.107-0.105=0.002
min35.751-35.755=-0.004
max36.102-36.099=0.003
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.075-0.076=-0.001
σ0.005-0.003=0.002
min0.068-0.073=-0.005
max0.082-0.083=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.064-26.064=0.000
σ0.003-0.003=0.000
min26.060-26.060=0.000
max26.068-26.067=0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.058-0.059=-0.001
σ0.002-0.004=-0.001
min0.056-0.056=-0.000
max0.064-0.067=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.919-1755.923=-0.004
σ0.369-0.367=0.001
min1755.347-1755.350=-0.004
max1756.513-1756.517=-0.004
mean1665.700-1667.850=-2.150
σ627.719-628.229=-0.510
min672.000-673.000=-1.000
max2656.000-2660.000=-4.000
mean2.788-2.832=-0.045
σ0.129-0.105=0.024
min2.523-2.545=-0.022
max2.956-2.997=-0.041

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.197-277.193=0.003
σ0.007-0.005=0.002
min277.189-277.187=0.002
max277.206-277.199=0.006
mean2656.000-2660.000=-4.000
σ0.000
min2656.000-2660.000=-4.000
max2656.000-2660.000=-4.000
mean0.394-0.395=-0.001
σ0.006-0.009=-0.003
min0.390-0.388=0.002
max0.405-0.411=-0.006
iters=5
new-facts=1
prior-facts=6402
mean2174.442-2174.425=0.018
σ0.011-0.012=-0.001
min2174.424-2174.411=0.014
max2174.452-2174.441=0.011
mean2656.000-2660.000=-4.000
σ0.000
min2656.000-2660.000=-4.000
max2656.000-2660.000=-4.000
mean2.944-3.002=-0.058
σ0.119-0.150=-0.031
min2.778-2.743=0.034
max3.070-3.106=-0.035
iters=5
new-facts=6402
prior-facts=1
mean5052.638-5052.342=0.296
σ0.990-0.453=0.537
min5052.034-5052.042=-0.008
max5054.396-5053.135=1.260
mean2656.000-2660.000=-4.000
σ0.000
min2656.000-2660.000=-4.000
max2656.000-2660.000=-4.000
mean8.714-8.812=-0.097
σ0.644-0.436=0.208
min8.251-8.240=0.011
max9.743-9.435=0.309
iters=5
new-facts=6402
prior-facts=6402
mean5188.426-5188.424=0.003
σ0.093-0.089=0.004
min5188.348-5188.353=-0.005
max5188.532-5188.526=0.006
mean3230.400-3252.400=-22.000
σ393.577-373.388=20.189
min2693.000-2730.000=-37.000
max3730.000-3708.000=22.000
mean8.928-8.879=0.049
σ0.411-0.331=0.079
min8.633-8.644=-0.011
max9.634-9.457=0.177

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.141-1.261=-0.120
σ0.314-0.369=-0.055
min0.937-0.945=-0.008
max1.653-1.850=-0.197

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.859-464.856=0.002
σ572.671-572.652=0.019
min178.522-178.527=-0.005
max1323.865-1323.835=0.031
mean79.500
σ7.000
min76.000
max90.000
mean2656.000-2660.000=-4.000
σ0.000
min2656.000-2660.000=-4.000
max2656.000-2660.000=-4.000
mean0.554-0.562=-0.008
σ0.535-0.545=-0.010
min0.281-0.289=-0.008
max1.356-1.379=-0.023
policies=20
mean1785.474-1785.490=-0.015
σ0.360-0.347=0.013
min1785.239-1785.256=-0.017
max1786.009-1786.004=0.005
mean760.000
σ0.000
min760.000
max760.000
mean2656.000-2660.000=-4.000
σ0.000
min2656.000-2660.000=-4.000
max2656.000-2660.000=-4.000
mean2.790-2.805=-0.015
σ0.011-0.014=-0.003
min2.777-2.793=-0.016
max2.803-2.822=-0.018
policies=200
mean17861.549-17861.417=0.132
σ0.489-0.626=-0.138
min17861.240-17861.010=0.231
max17862.279-17862.347=-0.068
mean7600.000
σ0.000
min7600.000
max7600.000
mean2656.000-2660.000=-4.000
σ0.000
min2656.000-2660.000=-4.000
max2656.000-2660.000=-4.000
mean28.193-28.239=-0.045
σ0.081-0.166=-0.085
min28.118-28.020=0.098
max28.301-28.397=-0.096