Compare commits

Home / Compare 3098002c .. ac8a080f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.781=0.000
σ0.046-0.047=-0.001
min70.748-70.750=-0.001
max70.909-70.910=-0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.159-0.158=0.000
σ0.003-0.005=-0.002
min0.155-0.149=0.006
max0.165-0.165=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.492-21.492=0.000
σ0.002-0.002=0.000
min21.488-21.489=-0.001
max21.496-21.495=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.066=-0.000
σ0.002-0.003=-0.001
min0.064-0.063=0.000
max0.070-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.092=0.001
σ0.361-0.359=0.002
min1753.528-1753.525=0.004
max1754.678-1754.661=0.017
mean1664.550-1632.150=32.400
σ628.592-597.187=31.405
min667.000-653.000=14.000
max2614.000-2430.000=184.000
mean2.842-2.860=-0.018
σ0.167-0.129=0.039
min2.356-2.521=-0.165
max3.087-3.066=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.598-271.598=0.000
σ0.006-0.006=-0.000
min271.591-271.591=0.000
max271.606-271.606=0.000
mean2614.000-2430.000=184.000
σ0.000
min2614.000-2430.000=184.000
max2614.000-2430.000=184.000
mean0.384-0.388=-0.004
σ0.004-0.006=-0.002
min0.381-0.381=-0.000
max0.391-0.395=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.003-1932.000=0.002
σ0.008-0.012=-0.004
min1931.990-1931.983=0.007
max1932.010-1932.014=-0.004
mean2614.000-2430.000=184.000
σ0.000
min2614.000-2430.000=184.000
max2614.000-2430.000=184.000
mean2.489-2.566=-0.077
σ0.043-0.119=-0.076
min2.434-2.501=-0.066
max2.555-2.777=-0.222
iters=5
new-facts=6402
prior-facts=1
mean4752.758-4752.543=0.215
σ0.917-1.048=-0.131
min4752.157-4751.806=0.351
max4754.367-4754.344=0.024
mean2614.000-2430.000=184.000
σ0.000
min2614.000-2430.000=184.000
max2614.000-2430.000=184.000
mean8.528-8.352=0.176
σ0.679-0.398=0.281
min7.582-7.888=-0.307
max9.282-8.804=0.478
iters=5
new-facts=6402
prior-facts=6402
mean4943.203-4943.207=-0.005
σ0.017-0.020=-0.003
min4943.185-4943.179=0.006
max4943.227-4943.230=-0.002
mean3011.400-2930.200=81.200
σ264.603-393.411=-128.808
min2619.000-2478.000=141.000
max3326.000-3428.000=-102.000
mean8.518-8.469=0.050
σ0.179-0.136=0.043
min8.301-8.301=0.000
max8.722-8.675=0.047

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.309-1.786=-0.478
σ0.357-0.131=0.227
min0.929-1.675=-0.745
max1.830-1.992=-0.162

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.628-468.625=0.003
σ574.937-574.921=0.016
min181.158-181.161=-0.003
max1331.034-1331.007=0.027
mean88.250
σ8.500
min84.000
max101.000
mean2614.000-2430.000=184.000
σ0.000
min2614.000-2430.000=184.000
max2614.000-2430.000=184.000
mean0.548-0.569=-0.021
σ0.524-0.549=-0.026
min0.284-0.288=-0.004
max1.333-1.393=-0.059
policies=20
mean1811.920-1811.921=-0.001
σ0.396-0.395=0.000
min1811.652-1811.646=0.006
max1812.503-1812.502=0.001
mean840.000
σ0.000
min840.000
max840.000
mean2614.000-2430.000=184.000
σ0.000
min2614.000-2430.000=184.000
max2614.000-2430.000=184.000
mean2.850-2.844=0.006
σ0.015-0.020=-0.005
min2.836-2.823=0.013
max2.871-2.872=-0.000
policies=200
mean18126.568-18126.454=0.114
σ0.524-0.370=0.154
min18126.172-18126.204=-0.031
max18127.311-18127.001=0.309
mean8400.000
σ0.000
min8400.000
max8400.000
mean2614.000-2430.000=184.000
σ0.000
min2614.000-2430.000=184.000
max2614.000-2430.000=184.000
mean28.773-28.705=0.068
σ0.124-0.100=0.025
min28.629-28.584=0.045
max28.922-28.813=0.109