Compare commits

Home / Compare 3d87d94f .. 7f500540

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.574-35.571=0.003
σ0.055-0.054=0.001
min35.542-35.535=0.006
max35.729-35.724=0.005
mean414.000-412.700=1.300
σ0.000-0.483=-0.483
min414.000-412.000=2.000
max414.000-413.000=1.000
mean0.086-0.085=0.001
σ0.004-0.003=0.000
min0.083-0.082=0.001
max0.093-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean24.002-24.001=0.002
σ0.003-0.003=-0.000
min23.999-23.996=0.003
max24.009-24.006=0.003
mean414.900-413.000=1.900
σ0.316-0.000=0.316
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.069-0.067=0.002
σ0.003-0.004=-0.001
min0.066-0.062=0.004
max0.074-0.074=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.503-1756.501=0.001
σ0.364-0.365=-0.001
min1755.929-1755.929=0.000
max1757.087-1757.092=-0.005
mean1654.850-1652.400=2.450
σ640.957-641.086=-0.129
min629.000-626.000=3.000
max2843.000-2839.000=4.000
mean2.371-2.367=0.004
σ0.133-0.115=0.018
min2.269-2.260=0.009
max2.784-2.630=0.155

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.734-324.731=0.003
σ0.056-0.055=0.002
min324.635-324.634=0.001
max324.770-324.770=-0.000
mean2843.000-2839.000=4.000
σ0.000
min2843.000-2839.000=4.000
max2843.000-2839.000=4.000
mean0.429-0.424=0.005
σ0.007-0.001=0.006
min0.422-0.423=-0.001
max0.440-0.426=0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.292-1985.289=0.003
σ0.019-0.016=0.004
min1985.258-1985.271=-0.013
max1985.305-1985.306=-0.001
mean2843.000-2839.000=4.000
σ0.000
min2843.000-2839.000=4.000
max2843.000-2839.000=4.000
mean2.667-2.633=0.034
σ0.131-0.102=0.028
min2.516-2.545=-0.030
max2.844-2.799=0.045
iters=5
new-facts=6402
prior-facts=1
mean4808.789-4808.913=-0.124
σ7.452-7.761=-0.308
min4805.427-4805.361=0.066
max4822.120-4822.796=-0.675
mean2843.000-2839.000=4.000
σ0.000
min2843.000-2839.000=4.000
max2843.000-2839.000=4.000
mean8.923-9.047=-0.124
σ0.113-0.290=-0.177
min8.774-8.756=0.018
max9.088-9.509=-0.421
iters=5
new-facts=6402
prior-facts=6402
mean4996.490-4996.291=0.199
σ0.018-0.195=-0.177
min4996.473-4996.121=0.351
max4996.519-4996.525=-0.006
mean3066.000-3051.400=14.600
σ299.803-287.020=12.784
min2843.000-2839.000=4.000
max3533.000-3504.000=29.000
mean8.587-8.558=0.030
σ0.122-0.095=0.027
min8.524-8.496=0.027
max8.805-8.724=0.081

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.013-0.965=0.048
σ0.068-0.061=0.007
min0.931-0.931=-0.001
max1.066-1.073=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.978-462.967=0.011
σ574.252-574.250=0.003
min175.839-175.836=0.003
max1324.357-1324.342=0.015
mean86.250
σ8.500
min82.000
max99.000
mean2843.000-2839.000=4.000
σ0.000
min2843.000-2839.000=4.000
max2843.000-2839.000=4.000
mean0.432-0.435=-0.002
σ0.300-0.304=-0.004
min0.280-0.279=0.001
max0.882-0.890=-0.008
policies=20
mean1758.723-1758.733=-0.010
σ0.344-0.351=-0.007
min1758.495-1758.495=0.001
max1759.232-1759.253=-0.021
mean820.000
σ0.000
min820.000
max820.000
mean2843.000-2839.000=4.000
σ0.000
min2843.000-2839.000=4.000
max2843.000-2839.000=4.000
mean2.798-2.803=-0.005
σ0.015-0.025=-0.010
min2.785-2.781=0.004
max2.818-2.825=-0.007
policies=200
mean17594.229-17594.340=-0.110
σ0.579-0.467=0.112
min17593.688-17594.022=-0.334
max17595.043-17595.033=0.010
mean8200.000
σ0.000
min8200.000
max8200.000
mean2843.000-2839.000=4.000
σ0.000
min2843.000-2839.000=4.000
max2843.000-2839.000=4.000
mean27.942-27.940=0.002
σ0.347-0.326=0.022
min27.598-27.620=-0.022
max28.270-28.304=-0.034