Compare commits

Home / Compare 6192c227 .. 2dac3bb2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.000
σ0.054-0.054=0.000
min35.589-35.586=0.003
max35.771-35.769=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.085-0.080=0.006
σ0.004-0.004=-0.000
min0.082-0.076=0.006
max0.093-0.088=0.005
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.001
σ0.004-0.004=0.000
min24.042-24.038=0.004
max24.053-24.051=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.066-0.066=0.001
σ0.004-0.004=0.000
min0.061-0.061=0.000
max0.074-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.491=-0.001
σ0.365-0.365=0.000
min1755.917-1755.916=0.000
max1757.083-1757.079=0.004
mean1646.750-1647.050=-0.300
σ641.579-639.374=2.205
min631.000-625.000=6.000
max2839.000-2822.000=17.000
mean2.356-2.328=0.028
σ0.076-0.075=0.001
min2.275-2.221=0.054
max2.550-2.549=0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.767-324.766=0.001
σ0.047-0.053=-0.006
min324.685-324.671=0.014
max324.800-324.794=0.006
mean2839.000-2822.000=17.000
σ0.000
min2839.000-2822.000=17.000
max2839.000-2822.000=17.000
mean0.428-0.431=-0.003
σ0.008-0.010=-0.001
min0.423-0.423=0.000
max0.442-0.442=0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.327-1985.317=0.009
σ0.005-0.022=-0.016
min1985.318-1985.297=0.021
max1985.331-1985.343=-0.012
mean2839.000-2822.000=17.000
σ0.000
min2839.000-2822.000=17.000
max2839.000-2822.000=17.000
mean2.623-2.636=-0.013
σ0.086-0.134=-0.048
min2.529-2.518=0.011
max2.731-2.812=-0.081
iters=5
new-facts=6402
prior-facts=1
mean4809.018-4809.120=-0.102
σ7.774-7.705=0.068
min4804.984-4805.573=-0.589
max4822.911-4822.903=0.008
mean2839.000-2822.000=17.000
σ0.000
min2839.000-2822.000=17.000
max2839.000-2822.000=17.000
mean9.015-8.833=0.182
σ0.426-0.473=-0.047
min8.339-7.993=0.346
max9.479-9.127=0.353
iters=5
new-facts=6402
prior-facts=6402
mean4996.623-4996.626=-0.003
σ0.025-0.024=0.001
min4996.600-4996.593=0.007
max4996.664-4996.653=0.010
mean3063.400-3054.400=9.000
σ306.063-303.324=2.739
min2839.000-2822.000=17.000
max3539.000-3520.000=19.000
mean8.558-8.512=0.046
σ0.092-0.122=-0.030
min8.465-8.410=0.055
max8.710-8.723=-0.013

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-0.978=-0.005
σ0.068-0.068=0.001
min0.912-0.921=-0.009
max1.061-1.058=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.217-463.210=0.006
σ574.772-574.773=-0.001
min175.821-175.814=0.007
max1325.374-1325.369=0.005
mean86.250
σ8.500
min82.000
max99.000
mean2839.000-2822.000=17.000
σ0.000
min2839.000-2822.000=17.000
max2839.000-2822.000=17.000
mean0.428-0.434=-0.006
σ0.290-0.301=-0.011
min0.281-0.280=0.001
max0.863-0.886=-0.023
policies=20
mean1758.535-1758.505=0.030
σ0.352-0.353=-0.001
min1758.296-1758.269=0.027
max1759.056-1759.030=0.025
mean820.000
σ0.000
min820.000
max820.000
mean2839.000-2822.000=17.000
σ0.000
min2839.000-2822.000=17.000
max2839.000-2822.000=17.000
mean2.812-2.780=0.032
σ0.021-0.006=0.015
min2.796-2.771=0.026
max2.843-2.783=0.060
policies=200
mean17592.114-17592.135=-0.021
σ0.411-0.487=-0.075
min17591.676-17591.828=-0.152
max17592.669-17592.861=-0.192
mean8200.000
σ0.000
min8200.000
max8200.000
mean2839.000-2822.000=17.000
σ0.000
min2839.000-2822.000=17.000
max2839.000-2822.000=17.000
mean27.892-27.803=0.090
σ0.396-0.378=0.018
min27.524-27.465=0.059
max28.327-28.224=0.103