Compare commits

Home / Compare c3d7557b .. 87a93e48

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.782=-0.000
σ0.046-0.046=0.000
min70.754-70.749=0.004
max70.909-70.908=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.160-0.159=0.001
σ0.004-0.005=-0.002
min0.156-0.151=0.005
max0.165-0.169=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.492-21.492=0.001
σ0.002-0.003=-0.001
min21.488-21.488=0.000
max21.494-21.498=-0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.061-0.061=0.001
σ0.003-0.003=-0.000
min0.059-0.058=0.001
max0.068-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.092=-0.000
σ0.361-0.361=0.000
min1753.527-1753.528=-0.001
max1754.681-1754.676=0.004
mean1664.550-1630.850=33.700
σ630.185-611.351=18.833
min666.000-637.000=29.000
max2618.000-2451.000=167.000
mean2.808-2.791=0.017
σ0.168-0.165=0.003
min2.423-2.330=0.093
max3.148-2.996=0.152

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-271.957=-0.002
σ0.008-0.006=0.002
min271.946-271.950=-0.004
max271.965-271.965=0.000
mean2618.000-2451.000=167.000
σ0.000
min2618.000-2451.000=167.000
max2618.000-2451.000=167.000
mean0.384-0.385=-0.001
σ0.005-0.006=-0.001
min0.380-0.381=-0.001
max0.391-0.396=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.331-1932.316=0.015
σ0.010-0.011=-0.000
min1932.320-1932.298=0.022
max1932.347-1932.323=0.024
mean2618.000-2451.000=167.000
σ0.000
min2618.000-2451.000=167.000
max2618.000-2451.000=167.000
mean2.993-3.096=-0.103
σ0.206-0.107=0.099
min2.694-3.016=-0.321
max3.191-3.264=-0.073
iters=5
new-facts=6402
prior-facts=1
mean4752.919-4753.055=-0.136
σ1.038-0.928=0.110
min4752.065-4752.587=-0.522
max4754.698-4754.713=-0.016
mean2618.000-2451.000=167.000
σ0.000
min2618.000-2451.000=167.000
max2618.000-2451.000=167.000
mean8.519-8.739=-0.219
σ0.672-0.478=0.195
min7.649-7.964=-0.315
max9.212-9.158=0.054
iters=5
new-facts=6402
prior-facts=6402
mean4943.490-4943.415=0.076
σ0.153-0.199=-0.046
min4943.217-4943.197=0.020
max4943.575-4943.576=-0.000
mean3015.200-2950.800=64.400
σ266.220-271.821=-5.601
min2620.000-2584.000=36.000
max3328.000-3304.000=24.000
mean8.591-8.490=0.101
σ0.160-0.036=0.124
min8.405-8.432=-0.026
max8.740-8.519=0.221

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.277-1.819=-0.541
σ0.362-0.121=0.241
min0.938-1.633=-0.695
max1.800-1.931=-0.131

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.658-468.651=0.007
σ574.936-574.922=0.015
min181.186-181.187=-0.001
max1331.063-1331.034=0.029
mean88.250
σ8.500
min84.000
max101.000
mean2618.000-2451.000=167.000
σ0.000
min2618.000-2451.000=167.000
max2618.000-2451.000=167.000
mean0.582-0.567=0.015
σ0.593-0.552=0.041
min0.283-0.286=-0.003
max1.471-1.394=0.077
policies=20
mean1812.174-1812.167=0.006
σ0.384-0.385=-0.000
min1811.926-1811.912=0.014
max1812.743-1812.737=0.006
mean840.000
σ0.000
min840.000
max840.000
mean2618.000-2451.000=167.000
σ0.000
min2618.000-2451.000=167.000
max2618.000-2451.000=167.000
mean2.833-2.820=0.012
σ0.006-0.017=-0.011
min2.827-2.802=0.025
max2.840-2.842=-0.002
policies=200
mean18129.130-18129.194=-0.063
σ0.600-0.538=0.062
min18128.623-18128.799=-0.177
max18129.998-18129.988=0.010
mean8400.000
σ0.000
min8400.000
max8400.000
mean2618.000-2451.000=167.000
σ0.000
min2618.000-2451.000=167.000
max2618.000-2451.000=167.000
mean28.560-28.474=0.086
σ0.076-0.088=-0.012
min28.452-28.399=0.053
max28.624-28.588=0.036