Compare commits

Home / Compare 84030a77 .. d059f858

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-70.699=-35.454
σ0.055-0.047=0.008
min35.212-70.665=-35.453
max35.399-70.829=-35.430
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.086-0.160=-0.074
σ0.004-0.004=-0.000
min0.083-0.156=-0.073
max0.092-0.166=-0.074
cache=y
dps=1
iters=10
policies=100
mean23.769-21.408=2.361
σ0.003-0.003=0.000
min23.764-21.405=2.359
max23.774-21.413=2.361
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.068-0.065=0.003
σ0.003-0.003=0.000
min0.066-0.063=0.003
max0.075-0.073=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1754.898=1.587
σ0.366-0.358=0.007
min1755.912-1754.339=1.573
max1757.073-1755.482=1.591
mean1643.600-1646.700=-3.100
σ624.705-632.656=-7.951
min626.000-619.000=7.000
max2826.000-2771.000=55.000
mean2.385-2.842=-0.457
σ0.125-0.216=-0.091
min2.271-2.188=0.084
max2.839-3.193=-0.354

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.712-272.758=51.954
σ0.040-0.002=0.038
min324.643-272.755=51.887
max324.745-272.760=51.985
mean2826.000-2771.000=55.000
σ0.000
min2826.000-2771.000=55.000
max2826.000-2771.000=55.000
mean0.426-0.386=0.040
σ0.006-0.006=0.001
min0.423-0.381=0.042
max0.438-0.394=0.043
iters=5
new-facts=1
prior-facts=6402
mean1985.262-1933.131=52.131
σ0.017-0.012=0.005
min1985.245-1933.115=52.130
max1985.278-1933.143=52.135
mean2826.000-2771.000=55.000
σ0.000
min2826.000-2771.000=55.000
max2826.000-2771.000=55.000
mean2.574-3.036=-0.462
σ0.083-0.040=0.042
min2.452-2.993=-0.541
max2.653-3.089=-0.436
iters=5
new-facts=6402
prior-facts=1
mean4809.008-4754.098=54.910
σ7.701-0.891=6.810
min4805.484-4753.523=51.961
max4822.784-4755.678=67.106
mean2826.000-2771.000=55.000
σ0.000
min2826.000-2771.000=55.000
max2826.000-2771.000=55.000
mean8.867-8.289=0.578
σ0.365-0.507=-0.142
min8.280-7.779=0.501
max9.118-9.039=0.079
iters=5
new-facts=6402
prior-facts=6402
mean4996.569-4944.463=52.106
σ0.016-0.011=0.006
min4996.553-4944.449=52.105
max4996.591-4944.477=52.114
mean3050.600-2987.600=63.000
σ204.462-211.214=-6.752
min2826.000-2771.000=55.000
max3347.000-3294.000=53.000
mean8.665-8.531=0.134
σ0.168-0.096=0.072
min8.497-8.430=0.067
max8.861-8.655=0.206

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.017-0.997=0.021
σ0.157-0.150=0.008
min0.912-0.927=-0.015
max1.283-1.265=0.019

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.214-468.917=-5.703
σ574.770-575.406=-0.636
min175.820-181.199=-5.379
max1325.370-1332.026=-6.657
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2826.000-2771.000=55.000
σ0.000
min2826.000-2771.000=55.000
max2826.000-2771.000=55.000
mean0.428-0.449=-0.020
σ0.297-0.301=-0.004
min0.278-0.298=-0.020
max0.874-0.900=-0.026
policies=20
mean1758.539-1812.290=-53.751
σ0.361-0.318=0.044
min1758.275-1812.108=-53.833
max1759.070-1812.765=-53.695
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2826.000-2771.000=55.000
σ0.000
min2826.000-2771.000=55.000
max2826.000-2771.000=55.000
mean2.791-2.928=-0.137
σ0.023-0.101=-0.077
min2.778-2.839=-0.061
max2.826-3.070=-0.244
policies=200
mean17592.508-18129.264=-536.756
σ0.519-0.520=-0.001
min17592.196-18128.834=-536.638
max17593.284-18130.021=-536.737
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2826.000-2771.000=55.000
σ0.000
min2826.000-2771.000=55.000
max2826.000-2771.000=55.000
mean27.905-28.638=-0.732
σ0.287-0.051=0.236
min27.643-28.580=-0.937
max28.193-28.701=-0.508