Compare commits

Home / Compare 21738dd6 .. 961b971a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=0.000
σ0.055-0.054=0.002
min35.587-35.590=-0.003
max35.775-35.770=0.005
mean414.000
σ0.000
min414.000
max414.000
mean0.086-0.083=0.002
σ0.004-0.005=-0.000
min0.081-0.076=0.005
max0.093-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-24.048=-0.001
σ0.003-0.003=-0.001
min24.045-24.044=0.001
max24.053-24.054=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.069=-0.006
σ0.004-0.003=0.001
min0.061-0.067=-0.007
max0.072-0.076=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.492=-0.002
σ0.365-0.366=-0.000
min1755.914-1755.919=-0.005
max1757.076-1757.078=-0.001
mean1642.300-1648.250=-5.950
σ643.911-633.167=10.744
min616.000-622.000=-6.000
max2718.000-2830.000=-112.000
mean2.385-2.326=0.059
σ0.113-0.103=0.010
min2.221-2.072=0.149
max2.633-2.497=0.135

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.765-324.778=-0.013
σ0.042-0.033=0.009
min324.691-324.722=-0.030
max324.792-324.807=-0.015
mean2718.000-2830.000=-112.000
σ0.000
min2718.000-2830.000=-112.000
max2718.000-2830.000=-112.000
mean0.428-0.423=0.005
σ0.009-0.001=0.008
min0.421-0.422=-0.001
max0.442-0.425=0.017
iters=5
new-facts=1
prior-facts=6402
mean1985.316-1985.323=-0.007
σ0.021-0.015=0.005
min1985.292-1985.306=-0.014
max1985.334-1985.337=-0.003
mean2718.000-2830.000=-112.000
σ0.000
min2718.000-2830.000=-112.000
max2718.000-2830.000=-112.000
mean2.631-2.621=0.010
σ0.102-0.054=0.048
min2.551-2.573=-0.022
max2.761-2.690=0.071
iters=5
new-facts=6402
prior-facts=1
mean4809.096-4808.808=0.288
σ7.647-7.790=-0.143
min4805.611-4804.837=0.774
max4822.775-4822.735=0.040
mean2718.000-2830.000=-112.000
σ0.000
min2718.000-2830.000=-112.000
max2718.000-2830.000=-112.000
mean8.962-8.712=0.250
σ0.362-0.264=0.099
min8.581-8.342=0.240
max9.521-9.044=0.477
iters=5
new-facts=6402
prior-facts=6402
mean4996.621-4996.530=0.092
σ0.028-0.025=0.003
min4996.589-4996.504=0.085
max4996.652-4996.563=0.089
mean2982.200-3034.200=-52.000
σ310.297-280.479=29.818
min2718.000-2830.000=-112.000
max3430.000-3475.000=-45.000
mean8.458-8.489=-0.031
σ0.049-0.150=-0.101
min8.398-8.370=0.028
max8.511-8.750=-0.240

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.974-0.944=0.030
σ0.145-0.056=0.088
min0.902-0.910=-0.008
max1.232-1.041=0.191

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.224-462.947=0.277
σ574.795-574.251=0.545
min175.814-175.819=-0.005
max1325.417-1324.323=1.094
mean86.250
σ8.500
min82.000
max99.000
mean2718.000-2830.000=-112.000
σ0.000
min2718.000-2830.000=-112.000
max2718.000-2830.000=-112.000
mean0.531-0.426=0.105
σ0.514-0.294=0.220
min0.273-0.276=-0.003
max1.302-0.867=0.435
policies=20
mean1758.498-1758.523=-0.025
σ0.321-0.340=-0.019
min1758.281-1758.315=-0.034
max1758.973-1759.030=-0.058
mean820.000
σ0.000
min820.000
max820.000
mean2718.000-2830.000=-112.000
σ0.000
min2718.000-2830.000=-112.000
max2718.000-2830.000=-112.000
mean2.694-2.791=-0.097
σ0.016-0.012=0.005
min2.677-2.781=-0.104
max2.711-2.807=-0.096
policies=200
mean17592.157-17591.973=0.184
σ0.533-0.546=-0.013
min17591.851-17591.663=0.188
max17592.955-17592.790=0.165
mean8200.000
σ0.000
min8200.000
max8200.000
mean2718.000-2830.000=-112.000
σ0.000
min2718.000-2830.000=-112.000
max2718.000-2830.000=-112.000
mean27.396-27.773=-0.377
σ0.121-0.392=-0.271
min27.239-27.360=-0.121
max27.519-28.176=-0.658