Compare commits

Home / Compare 134cd4ee .. 05138576

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.564=0.003
σ0.048-0.046=0.002
min70.537-70.537=0.000
max70.700-70.694=0.006
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.157-0.158=-0.001
σ0.005-0.005=0.000
min0.151-0.150=0.001
max0.165-0.165=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.002=0.000
min21.284-21.284=-0.000
max21.291-21.290=0.001
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.065-0.064=0.001
σ0.003-0.003=-0.000
min0.063-0.058=0.005
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.173-1753.172=0.002
σ0.361-0.362=-0.001
min1752.605-1752.612=-0.007
max1753.761-1753.753=0.008
mean1676.300-1663.200=13.100
σ636.278-631.198=5.081
min692.000-686.000=6.000
max2823.000-2802.000=21.000
mean2.800-2.843=-0.043
σ0.179-0.109=0.070
min2.182-2.587=-0.405
max3.012-3.121=-0.108

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.617-271.620=-0.003
σ0.006-0.008=-0.002
min271.611-271.608=0.003
max271.625-271.628=-0.003
mean2823.000-2802.000=21.000
σ0.000
min2823.000-2802.000=21.000
max2823.000-2802.000=21.000
mean0.382-0.382=0.000
σ0.010-0.006=0.004
min0.368-0.378=-0.010
max0.396-0.392=0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.047-1932.049=-0.003
σ0.007-0.022=-0.015
min1932.039-1932.016=0.024
max1932.054-1932.073=-0.019
mean2823.000-2802.000=21.000
σ0.000
min2823.000-2802.000=21.000
max2823.000-2802.000=21.000
mean2.969-2.912=0.057
σ0.199-0.256=-0.056
min2.754-2.470=0.284
max3.172-3.085=0.087
iters=5
new-facts=6402
prior-facts=1
mean4752.849-4752.800=0.049
σ0.794-0.876=-0.082
min4752.411-4752.304=0.107
max4754.267-4754.361=-0.093
mean2823.000-2802.000=21.000
σ0.000
min2823.000-2802.000=21.000
max2823.000-2802.000=21.000
mean8.002-8.479=-0.477
σ0.309-0.404=-0.096
min7.728-7.956=-0.228
max8.529-9.002=-0.473
iters=5
new-facts=6402
prior-facts=6402
mean4943.231-4943.242=-0.011
σ0.009-0.013=-0.004
min4943.224-4943.228=-0.004
max4943.243-4943.256=-0.013
mean3055.200-2999.400=55.800
σ300.711-204.251=96.461
min2823.000-2802.000=21.000
max3517.000-3303.000=214.000
mean8.388-8.493=-0.105
σ0.157-0.114=0.043
min8.199-8.364=-0.165
max8.623-8.618=0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.194-1.011=0.183
σ0.186-0.175=0.011
min1.071-0.929=0.142
max1.500-1.323=0.177

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.294-472.292=0.002
σ575.924-575.915=0.009
min184.324-184.325=-0.001
max1336.181-1336.165=0.016
mean88.250
σ8.500
min84.000
max101.000
mean2823.000-2802.000=21.000
σ0.000
min2823.000-2802.000=21.000
max2823.000-2802.000=21.000
mean0.486-0.532=-0.047
σ0.379-0.352=0.027
min0.293-0.303=-0.010
max1.054-1.047=0.007
policies=20
mean1843.600-1843.541=0.059
σ0.398-0.353=0.046
min1843.308-1843.301=0.007
max1844.181-1844.058=0.122
mean840.000
σ0.000
min840.000
max840.000
mean2823.000-2802.000=21.000
σ0.000
min2823.000-2802.000=21.000
max2823.000-2802.000=21.000
mean2.976-2.912=0.064
σ0.082-0.049=0.033
min2.914-2.869=0.045
max3.096-2.969=0.127
policies=200
mean18442.034-18442.144=-0.110
σ0.465-0.496=-0.032
min18441.729-18441.762=-0.032
max18442.712-18442.867=-0.155
mean8400.000
σ0.000
min8400.000
max8400.000
mean2823.000-2802.000=21.000
σ0.000
min2823.000-2802.000=21.000
max2823.000-2802.000=21.000
mean29.033-29.062=-0.029
σ0.076-0.147=-0.071
min28.959-28.856=0.103
max29.108-29.203=-0.095