Compare commits

Home / Compare 87a93e48 .. b0f577e5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.125-70.781=2.344
σ0.053-0.046=0.007
min73.095-70.754=2.341
max73.275-70.909=2.366
mean415.400-415.000=0.400
σ0.516-0.000=0.516
min415.000
max416.000-415.000=1.000
mean0.161-0.160=0.001
σ0.003-0.004=-0.000
min0.158-0.156=0.002
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean23.754-21.492=2.261
σ0.003-0.002=0.001
min23.749-21.488=2.261
max23.760-21.494=2.266
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.066-0.061=0.004
σ0.004-0.003=0.001
min0.061-0.059=0.002
max0.074-0.068=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.823-1754.092=1.731
σ0.361-0.361=-0.000
min1755.249-1753.527=1.722
max1756.398-1754.681=1.717
mean1652.250-1664.550=-12.300
σ632.511-630.185=2.327
min628.000-666.000=-38.000
max2850.000-2618.000=232.000
mean2.825-2.808=0.017
σ0.231-0.168=0.063
min2.348-2.423=-0.076
max3.447-3.148=0.298

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean321.064-271.955=49.108
σ0.012-0.008=0.004
min321.045-271.946=49.099
max321.077-271.965=49.112
mean2850.000-2618.000=232.000
σ0.000
min2850.000-2618.000=232.000
max2850.000-2618.000=232.000
mean0.420-0.384=0.036
σ0.001-0.005=-0.004
min0.418-0.380=0.038
max0.421-0.391=0.030
iters=5
new-facts=1
prior-facts=6402
mean1981.628-1932.331=49.297
σ0.008-0.010=-0.002
min1981.615-1932.320=49.295
max1981.635-1932.347=49.288
mean2850.000-2618.000=232.000
σ0.000
min2850.000-2618.000=232.000
max2850.000-2618.000=232.000
mean2.599-2.993=-0.394
σ0.071-0.206=-0.135
min2.531-2.694=-0.163
max2.698-3.191=-0.493
iters=5
new-facts=6402
prior-facts=1
mean4805.237-4752.919=52.318
σ7.708-1.038=6.670
min4801.726-4752.065=49.661
max4819.025-4754.698=64.328
mean2850.000-2618.000=232.000
σ0.000
min2850.000-2618.000=232.000
max2850.000-2618.000=232.000
mean8.703-8.519=0.183
σ0.214-0.672=-0.458
min8.402-7.649=0.753
max8.882-9.212=-0.329
iters=5
new-facts=6402
prior-facts=6402
mean4992.832-4943.490=49.342
σ0.020-0.153=-0.133
min4992.813-4943.217=49.596
max4992.862-4943.575=49.286
mean3066.400-3015.200=51.200
σ225.820-266.220=-40.400
min2850.000-2620.000=230.000
max3300.000-3328.000=-28.000
mean8.703-8.591=0.112
σ0.259-0.160=0.100
min8.441-8.405=0.036
max9.094-8.740=0.354

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.005-1.277=-0.272
σ0.131-0.362=-0.231
min0.918-0.938=-0.019
max1.219-1.800=-0.581

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.420-468.658=-6.238
σ574.246-574.936=-0.690
min175.289-181.186=-5.897
max1323.789-1331.063=-7.273
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2850.000-2618.000=232.000
σ0.000
min2850.000-2618.000=232.000
max2850.000-2618.000=232.000
mean0.426-0.582=-0.155
σ0.296-0.593=-0.297
min0.276-0.283=-0.006
max0.871-1.471=-0.600
policies=20
mean1753.226-1812.174=-58.948
σ0.376-0.384=-0.008
min1752.990-1811.926=-58.936
max1753.787-1812.743=-58.955
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2850.000-2618.000=232.000
σ0.000
min2850.000-2618.000=232.000
max2850.000-2618.000=232.000
mean2.780-2.833=-0.053
σ0.011-0.006=0.005
min2.764-2.827=-0.062
max2.789-2.840=-0.051
policies=200
mean17538.887-18129.130=-590.243
σ0.515-0.600=-0.085
min17538.284-18128.623=-590.339
max17539.362-18129.998=-590.636
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2850.000-2618.000=232.000
σ0.000
min2850.000-2618.000=232.000
max2850.000-2618.000=232.000
mean27.844-28.560=-0.716
σ0.446-0.076=0.369
min27.371-28.452=-1.081
max28.382-28.624=-0.242