Compare commits

Home / Compare e08cb20d .. 72d6c49c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.001
σ0.055-0.053=0.003
min35.589-35.590=-0.000
max35.775-35.767=0.008
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.086-0.084=0.003
σ0.004-0.005=-0.001
min0.083-0.077=0.006
max0.093-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean24.048-24.046=0.002
σ0.003-0.003=0.001
min24.043-24.040=0.003
max24.052-24.050=0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.068-0.064=0.004
σ0.003-0.003=-0.000
min0.066-0.061=0.005
max0.075-0.069=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.491=-0.001
σ0.364-0.364=0.000
min1755.916-1755.916=-0.000
max1757.074-1757.075=-0.002
mean1653.950-1650.750=3.200
σ644.680-644.690=-0.011
min627.000-631.000=-4.000
max2846.000-2838.000=8.000
mean2.332-2.339=-0.007
σ0.068-0.079=-0.011
min2.262-2.257=0.004
max2.530-2.488=0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.760-324.761=-0.001
σ0.062-0.055=0.007
min324.650-324.663=-0.013
max324.796-324.791=0.005
mean2846.000-2838.000=8.000
σ0.000
min2846.000-2838.000=8.000
max2846.000-2838.000=8.000
mean0.431-0.428=0.003
σ0.009-0.008=0.001
min0.423-0.424=-0.001
max0.441-0.442=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.322-1985.319=0.002
σ0.010-0.022=-0.011
min1985.306-1985.290=0.016
max1985.333-1985.340=-0.007
mean2846.000-2838.000=8.000
σ0.000
min2846.000-2838.000=8.000
max2846.000-2838.000=8.000
mean2.758-2.624=0.134
σ0.138-0.142=-0.005
min2.536-2.517=0.019
max2.911-2.864=0.047
iters=5
new-facts=6402
prior-facts=1
mean4809.090-4808.991=0.099
σ7.658-7.752=-0.093
min4805.589-4805.040=0.549
max4822.789-4822.848=-0.059
mean2846.000-2838.000=8.000
σ0.000
min2846.000-2838.000=8.000
max2846.000-2838.000=8.000
mean8.925-8.748=0.176
σ0.344-0.337=0.007
min8.546-8.155=0.391
max9.472-8.956=0.516
iters=5
new-facts=6402
prior-facts=6402
mean4996.564-4996.487=0.076
σ0.149-0.196=-0.047
min4996.297-4996.246=0.051
max4996.642-4996.655=-0.014
mean3050.800-3061.800=-11.000
σ217.447-296.069=-78.622
min2846.000-2838.000=8.000
max3278.000-3517.000=-239.000
mean8.579-8.502=0.077
σ0.106-0.109=-0.003
min8.482-8.416=0.066
max8.746-8.687=0.059

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.971-0.948=0.024
σ0.070-0.064=0.006
min0.906-0.896=0.009
max1.050-1.057=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.207-463.205=0.002
σ574.774-574.767=0.007
min175.814-175.815=-0.001
max1325.368-1325.355=0.012
mean86.250
σ8.500
min82.000
max99.000
mean2846.000-2838.000=8.000
σ0.000
min2846.000-2838.000=8.000
max2846.000-2838.000=8.000
mean0.433-0.434=-0.001
σ0.303-0.297=0.006
min0.279-0.280=-0.002
max0.887-0.879=0.008
policies=20
mean1758.533-1758.533=0.000
σ0.338-0.350=-0.013
min1758.299-1758.288=0.010
max1759.031-1759.049=-0.018
mean820.000
σ0.000
min820.000
max820.000
mean2846.000-2838.000=8.000
σ0.000
min2846.000-2838.000=8.000
max2846.000-2838.000=8.000
mean2.799-2.800=-0.000
σ0.039-0.008=0.031
min2.773-2.789=-0.017
max2.858-2.809=0.049
policies=200
mean17592.115-17592.078=0.037
σ0.423-0.446=-0.023
min17591.755-17591.633=0.121
max17592.727-17592.690=0.037
mean8200.000
σ0.000
min8200.000
max8200.000
mean2846.000-2838.000=8.000
σ0.000
min2846.000-2838.000=8.000
max2846.000-2838.000=8.000
mean27.840-27.898=-0.058
σ0.323-0.528=-0.205
min27.489-27.456=0.033
max28.163-28.521=-0.358