Compare commits

Home / Compare dce2444f .. c4cbc925

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.127-73.044=0.083
σ0.052-0.047=0.006
min73.103-73.021=0.082
max73.275-73.176=0.099
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.162-0.159=0.003
σ0.003-0.006=-0.002
min0.159-0.151=0.008
max0.168-0.168=0.000
cache=y
dps=1
iters=10
policies=100
mean23.755-23.739=0.016
σ0.002-0.004=-0.001
min23.752-23.734=0.018
max23.758-23.747=0.011
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.067-0.066=0.001
σ0.004-0.002=0.002
min0.061-0.064=-0.004
max0.076-0.071=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.822-1758.788=-2.966
σ0.360-0.361=-0.001
min1755.252-1758.217=-2.965
max1756.411-1759.368=-2.957
mean1662.200-1656.350=5.850
σ636.220-620.065=16.156
min630.000-632.000=-2.000
max2839.000-2504.000=335.000
mean2.765-2.806=-0.040
σ0.210-0.156=0.054
min2.324-2.235=0.090
max3.157-2.996=0.160

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean321.044-324.015=-2.971
σ0.055-0.061=-0.006
min320.946-323.906=-2.959
max321.073-324.047=-2.974
mean2839.000-2504.000=335.000
σ0.000
min2839.000-2504.000=335.000
max2839.000-2504.000=335.000
mean0.424-0.435=-0.011
σ0.003-0.015=-0.012
min0.420-0.426=-0.007
max0.429-0.462=-0.033
iters=5
new-facts=1
prior-facts=6402
mean1981.617-1984.587=-2.970
σ0.019-0.019=-0.000
min1981.583-1984.560=-2.977
max1981.629-1984.607=-2.977
mean2839.000-2504.000=335.000
σ0.000
min2839.000-2504.000=335.000
max2839.000-2504.000=335.000
mean2.650-2.649=0.002
σ0.168-0.112=0.056
min2.484-2.556=-0.072
max2.922-2.772=0.149
iters=5
new-facts=6402
prior-facts=1
mean4805.142-4808.117=-2.976
σ7.476-7.577=-0.102
min4801.765-4804.637=-2.872
max4818.514-4821.671=-3.157
mean2839.000-2504.000=335.000
σ0.000
min2839.000-2504.000=335.000
max2839.000-2504.000=335.000
mean8.909-8.816=0.093
σ0.139-0.315=-0.176
min8.677-8.454=0.223
max9.034-9.117=-0.083
iters=5
new-facts=6402
prior-facts=6402
mean4992.830-4995.811=-2.981
σ0.018-0.013=0.005
min4992.811-4995.794=-2.984
max4992.851-4995.826=-2.975
mean3033.800-2951.000=82.800
σ198.310-382.573=-184.263
min2839.000-2504.000=335.000
max3307.000-3445.000=-138.000
mean8.705-9.010=-0.305
σ0.116-0.449=-0.333
min8.550-8.480=0.070
max8.823-9.677=-0.854

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.010-1.639=-0.629
σ0.135-0.225=-0.090
min0.920-1.240=-0.320
max1.228-1.774=-0.546

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.427-468.329=-5.902
σ574.250-574.231=0.019
min175.287-181.208=-5.921
max1323.802-1329.674=-5.873
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2839.000-2504.000=335.000
σ0.000
min2839.000-2504.000=335.000
max2839.000-2504.000=335.000
mean0.431-0.572=-0.141
σ0.299-0.575=-0.275
min0.279-0.280=-0.001
max0.880-1.434=-0.554
policies=20
mean1753.228-1812.440=-59.212
σ0.371-0.391=-0.021
min1752.987-1812.180=-59.192
max1753.780-1813.018=-59.238
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2839.000-2504.000=335.000
σ0.000
min2839.000-2504.000=335.000
max2839.000-2504.000=335.000
mean2.782-2.820=-0.038
σ0.011-0.019=-0.008
min2.771-2.800=-0.028
max2.797-2.845=-0.048
policies=200
mean17538.524-18131.547=-593.023
σ0.664-0.617=0.046
min17537.612-18131.096=-593.484
max17539.203-18132.459=-593.256
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2839.000-2504.000=335.000
σ0.000
min2839.000-2504.000=335.000
max2839.000-2504.000=335.000
mean27.921-28.399=-0.478
σ0.302-0.055=0.247
min27.600-28.323=-0.723
max28.229-28.440=-0.211