Compare commits

Home / Compare 0ba785ac .. 9e209604

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.783=-0.002
σ0.047-0.047=0.000
min70.741-70.747=-0.006
max70.910-70.913=-0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.157-0.163=-0.005
σ0.005-0.005=-0.000
min0.150-0.157=-0.007
max0.165-0.170=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.001
σ0.003-0.002=0.000
min21.487-21.488=-0.001
max21.495-21.497=-0.002
mean413.000
σ0.000
min413.000
max413.000
mean0.065-0.067=-0.002
σ0.003-0.002=0.000
min0.063-0.065=-0.002
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.096-1754.095=0.001
σ0.361-0.361=0.001
min1753.531-1753.530=0.001
max1754.676-1754.675=0.001
mean1663.850-1662.000=1.850
σ636.617-635.055=1.563
min628.000-627.000=1.000
max2783.000-2713.000=70.000
mean2.856-2.810=0.046
σ0.094-0.200=-0.106
min2.605-2.230=0.375
max3.054-3.085=-0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-271.952=0.003
σ0.006-0.005=0.000
min271.948-271.947=0.001
max271.964-271.959=0.004
mean2783.000-2713.000=70.000
σ0.000
min2783.000-2713.000=70.000
max2783.000-2713.000=70.000
mean0.387-0.382=0.006
σ0.008-0.006=0.002
min0.378-0.377=0.001
max0.394-0.393=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.321-1932.321=0.000
σ0.003-0.008=-0.006
min1932.319-1932.314=0.005
max1932.325-1932.334=-0.009
mean2783.000-2713.000=70.000
σ0.000
min2783.000-2713.000=70.000
max2783.000-2713.000=70.000
mean3.057-3.088=-0.031
σ0.074-0.115=-0.040
min2.984-2.990=-0.006
max3.140-3.267=-0.127
iters=5
new-facts=6402
prior-facts=1
mean4753.111-4752.891=0.220
σ0.894-1.016=-0.122
min4752.573-4752.284=0.289
max4754.700-4754.688=0.012
mean2783.000-2713.000=70.000
σ0.000
min2783.000-2713.000=70.000
max2783.000-2713.000=70.000
mean8.295-8.526=-0.231
σ0.585-0.549=0.036
min7.395-7.888=-0.494
max8.983-8.942=0.042
iters=5
new-facts=6402
prior-facts=6402
mean4943.489-4943.560=-0.071
σ0.166-0.013=0.153
min4943.192-4943.541=-0.350
max4943.571-4943.577=-0.005
mean2999.600-3022.000=-22.400
σ221.720-270.158=-48.438
min2783.000-2713.000=70.000
max3323.000-3384.000=-61.000
mean8.475-8.570=-0.095
σ0.098-0.126=-0.028
min8.372-8.402=-0.031
max8.580-8.741=-0.161

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.069-0.997=0.072
σ0.113-0.136=-0.024
min0.928-0.930=-0.002
max1.243-1.241=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.662-468.661=0.001
σ574.923-574.937=-0.014
min181.194-181.191=0.003
max1331.047-1331.067=-0.019
mean88.250
σ8.500
min84.000
max101.000
mean2783.000-2713.000=70.000
σ0.000
min2783.000-2713.000=70.000
max2783.000-2713.000=70.000
mean0.447-0.567=-0.120
σ0.303-0.543=-0.241
min0.292-0.290=0.002
max0.901-1.382=-0.481
policies=20
mean1812.234-1812.182=0.052
σ0.384-0.387=-0.003
min1811.954-1811.921=0.033
max1812.792-1812.753=0.038
mean840.000
σ0.000
min840.000
max840.000
mean2783.000-2713.000=70.000
σ0.000
min2783.000-2713.000=70.000
max2783.000-2713.000=70.000
mean2.948-2.843=0.105
σ0.041-0.011=0.030
min2.917-2.835=0.082
max3.004-2.859=0.146
policies=200
mean18129.182-18129.085=0.096
σ0.386-0.417=-0.031
min18128.916-18128.717=0.199
max18129.753-18129.670=0.083
mean8400.000
σ0.000
min8400.000
max8400.000
mean2783.000-2713.000=70.000
σ0.000
min2783.000-2713.000=70.000
max2783.000-2713.000=70.000
mean28.449-28.525=-0.077
σ0.060-0.068=-0.007
min28.371-28.427=-0.056
max28.497-28.579=-0.081