Compare commits

Home / Compare d059f858 .. 966692be

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.245=0.018
σ0.053-0.055=-0.002
min35.235-35.212=0.023
max35.413-35.399=0.013
mean418.000-411.000=7.000
σ0.000
min418.000-411.000=7.000
max418.000-411.000=7.000
mean0.085-0.086=-0.001
σ0.003-0.004=-0.000
min0.083-0.083=-0.001
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.001
σ0.003-0.003=0.000
min23.766-23.764=0.002
max23.774-23.774=0.001
mean418.000-411.000=7.000
σ0.000
min418.000-411.000=7.000
max418.000-411.000=7.000
mean0.067-0.068=-0.001
σ0.003-0.003=-0.000
min0.063-0.066=-0.004
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1756.485=-0.001
σ0.364-0.366=-0.002
min1755.910-1755.912=-0.002
max1757.068-1757.073=-0.005
mean1647.250-1643.600=3.650
σ626.702-624.705=1.997
min633.000-626.000=7.000
max2836.000-2826.000=10.000
mean2.382-2.385=-0.004
σ0.103-0.125=-0.022
min2.089-2.271=-0.182
max2.581-2.839=-0.258

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.707-324.712=-0.005
σ0.058-0.040=0.018
min324.604-324.643=-0.038
max324.741-324.745=-0.003
mean2836.000-2826.000=10.000
σ0.000
min2836.000-2826.000=10.000
max2836.000-2826.000=10.000
mean0.433-0.426=0.007
σ0.011-0.006=0.004
min0.423-0.423=-0.000
max0.448-0.438=0.010
iters=5
new-facts=1
prior-facts=6402
mean1985.270-1985.262=0.008
σ0.013-0.017=-0.004
min1985.250-1985.245=0.005
max1985.282-1985.278=0.003
mean2836.000-2826.000=10.000
σ0.000
min2836.000-2826.000=10.000
max2836.000-2826.000=10.000
mean2.685-2.574=0.111
σ0.169-0.083=0.087
min2.468-2.452=0.016
max2.890-2.653=0.237
iters=5
new-facts=6402
prior-facts=1
mean4808.937-4809.008=-0.071
σ7.784-7.701=0.083
min4804.924-4805.484=-0.561
max4822.850-4822.784=0.066
mean2836.000-2826.000=10.000
σ0.000
min2836.000-2826.000=10.000
max2836.000-2826.000=10.000
mean8.910-8.867=0.042
σ0.414-0.365=0.049
min8.212-8.280=-0.068
max9.308-9.118=0.190
iters=5
new-facts=6402
prior-facts=6402
mean4996.485-4996.569=-0.084
σ0.148-0.016=0.131
min4996.229-4996.553=-0.324
max4996.584-4996.591=-0.007
mean3071.600-3050.600=21.000
σ309.249-204.462=104.787
min2836.000-2826.000=10.000
max3550.000-3347.000=203.000
mean8.659-8.665=-0.006
σ0.211-0.168=0.043
min8.431-8.497=-0.066
max8.896-8.861=0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.069-1.017=0.052
σ0.261-0.157=0.103
min0.919-0.912=0.007
max1.524-1.283=0.241

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.211-463.214=-0.003
σ574.771-574.770=0.001
min175.818-175.820=-0.002
max1325.367-1325.370=-0.002
mean86.250
σ8.500
min82.000
max99.000
mean2836.000-2826.000=10.000
σ0.000
min2836.000-2826.000=10.000
max2836.000-2826.000=10.000
mean0.433-0.428=0.004
σ0.302-0.297=0.005
min0.278-0.278=0.001
max0.886-0.874=0.012
policies=20
mean1758.553-1758.539=0.014
σ0.357-0.361=-0.004
min1758.302-1758.275=0.026
max1759.081-1759.070=0.011
mean820.000
σ0.000
min820.000
max820.000
mean2836.000-2826.000=10.000
σ0.000
min2836.000-2826.000=10.000
max2836.000-2826.000=10.000
mean2.800-2.791=0.009
σ0.013-0.023=-0.010
min2.787-2.778=0.009
max2.818-2.826=-0.008
policies=200
mean17592.633-17592.508=0.125
σ0.493-0.519=-0.027
min17592.200-17592.196=0.004
max17593.342-17593.284=0.058
mean8200.000
σ0.000
min8200.000
max8200.000
mean2836.000-2826.000=10.000
σ0.000
min2836.000-2826.000=10.000
max2836.000-2826.000=10.000
mean28.000-27.905=0.094
σ0.459-0.287=0.172
min27.547-27.643=-0.096
max28.570-28.193=0.378