Compare commits

Home / Compare b299aeec .. a7513882

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.429-54.429=0.001
σ0.050-0.049=0.001
min54.391-54.380=0.011
max54.564-54.560=0.004
mean417.600-418.400=-0.800
σ0.843-0.966=-0.123
min416.000-417.000=-1.000
max418.000-419.000=-1.000
mean0.137-0.135=0.002
σ0.005-0.004=0.001
min0.130-0.130=-0.000
max0.145-0.141=0.003
cache=y
dps=1
iters=10
policies=100
mean43.759-43.760=-0.001
σ0.005-0.006=-0.001
min43.751-43.750=0.002
max43.766-43.767=-0.001
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.115-0.117=-0.002
σ0.005-0.003=0.002
min0.110-0.114=-0.004
max0.122-0.122=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1764.850-1764.851=-0.001
σ0.364-0.367=-0.002
min1764.271-1764.271=0.000
max1765.432-1765.441=-0.009
mean1649.300-1641.700=7.600
σ603.289-604.637=-1.348
min629.000-661.000=-32.000
max2460.000-2451.000=9.000
mean2.590-2.599=-0.009
σ0.247-0.268=-0.021
min2.331-2.321=0.010
max3.049-3.094=-0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean345.190-345.196=-0.006
σ0.068-0.072=-0.004
min345.069
max345.225-345.239=-0.014
mean2460.000-2451.000=9.000
σ0.000
min2460.000-2451.000=9.000
max2460.000-2451.000=9.000
mean0.446-0.449=-0.003
σ0.001-0.008=-0.007
min0.444-0.443=0.001
max0.447-0.463=-0.016
iters=5
new-facts=1
prior-facts=6402
mean2007.367-2007.362=0.006
σ0.018-0.013=0.005
min2007.342-2007.343=-0.001
max2007.390-2007.375=0.015
mean2460.000-2451.000=9.000
σ0.000
min2460.000-2451.000=9.000
max2460.000-2451.000=9.000
mean2.702-2.766=-0.063
σ0.079-0.240=-0.162
min2.591-2.553=0.038
max2.809-3.160=-0.352
iters=5
new-facts=6402
prior-facts=1
mean4832.135-4832.033=0.102
σ7.830-7.847=-0.017
min4828.377-4828.115=0.262
max4846.139-4846.061=0.078
mean2460.000-2451.000=9.000
σ0.000
min2460.000-2451.000=9.000
max2460.000-2451.000=9.000
mean8.869-8.339=0.530
σ0.550-0.628=-0.078
min8.252-7.784=0.468
max9.464-9.187=0.278
iters=5
new-facts=6402
prior-facts=6402
mean5019.768-5019.770=-0.002
σ0.018-0.018=-0.000
min5019.748-5019.745=0.003
max5019.788-5019.791=-0.002
mean3005.000-2951.000=54.000
σ280.545-442.078=-161.533
min2614.000-2460.000=154.000
max3315.000-3546.000=-231.000
mean9.818-9.401=0.417
σ0.139-0.594=-0.455
min9.640-8.497=1.144
max9.994-10.107=-0.113

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.634-1.777=-0.143
σ0.174-0.085=0.089
min1.392-1.628=-0.237
max1.839-1.836=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.701-466.699=0.003
σ574.762-574.757=0.005
min179.316-179.318=-0.001
max1328.844-1328.834=0.010
mean90.250
σ8.500
min86.000
max103.000
mean2460.000-2451.000=9.000
σ0.000
min2460.000-2451.000=9.000
max2460.000-2451.000=9.000
mean0.548-0.553=-0.005
σ0.545-0.548=-0.003
min0.272-0.277=-0.005
max1.366-1.375=-0.009
policies=20
mean1793.449-1793.464=-0.015
σ0.381-0.390=-0.009
min1793.200-1793.206=-0.007
max1794.015-1794.042=-0.027
mean860.000
σ0.000
min860.000
max860.000
mean2460.000-2451.000=9.000
σ0.000
min2460.000-2451.000=9.000
max2460.000-2451.000=9.000
mean2.746-2.747=-0.001
σ0.011-0.010=0.001
min2.734-2.740=-0.005
max2.760-2.762=-0.002
policies=200
mean17941.996-17942.126=-0.130
σ0.439-0.395=0.044
min17941.664-17941.841=-0.177
max17942.642-17942.711=-0.068
mean8600.000
σ0.000
min8600.000
max8600.000
mean2460.000-2451.000=9.000
σ0.000
min2460.000-2451.000=9.000
max2460.000-2451.000=9.000
mean27.736-27.780=-0.045
σ0.043-0.080=-0.036
min27.675-27.673=0.003
max27.777-27.859=-0.082