Compare commits

Home / Compare f96d5cf7 .. d8367874

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.732-70.728=0.004
σ0.048-0.044=0.004
min70.700-70.704=-0.004
max70.863-70.851=0.012
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.158-0.159=-0.001
σ0.004-0.003=0.001
min0.150-0.156=-0.005
max0.163-0.164=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.446-21.448=-0.002
σ0.003-0.011=-0.008
min21.442-21.441=0.001
max21.450-21.478=-0.029
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.065-0.063=0.002
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.071-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.526-1754.527=-0.001
σ0.359-0.360=-0.001
min1753.954-1753.958=-0.004
max1755.102-1755.104=-0.002
mean1643.000-1658.550=-15.550
σ631.259-644.125=-12.867
min640.000-624.000=16.000
max2860.000-2867.000=-7.000
mean2.829-2.817=0.012
σ0.162-0.172=-0.010
min2.284-2.298=-0.015
max3.079-3.206=-0.127

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.609-273.607=0.002
σ0.010-0.008=0.001
min273.600-273.597=0.003
max273.625-273.618=0.008
mean2860.000-2867.000=-7.000
σ0.000
min2860.000-2867.000=-7.000
max2860.000-2867.000=-7.000
mean0.395-0.383=0.013
σ0.010-0.004=0.006
min0.382-0.380=0.002
max0.411-0.390=0.021
iters=5
new-facts=1
prior-facts=6402
mean1933.996-1934.012=-0.017
σ0.011-0.015=-0.004
min1933.980-1933.987=-0.007
max1934.008-1934.021=-0.013
mean2860.000-2867.000=-7.000
σ0.000
min2860.000-2867.000=-7.000
max2860.000-2867.000=-7.000
mean3.024-3.030=-0.006
σ0.167-0.239=-0.071
min2.855-2.732=0.123
max3.253-3.284=-0.031
iters=5
new-facts=6402
prior-facts=1
mean4754.625-4754.770=-0.144
σ0.944-0.791=0.152
min4753.885-4754.323=-0.438
max4756.274-4756.180=0.094
mean2860.000-2867.000=-7.000
σ0.000
min2860.000-2867.000=-7.000
max2860.000-2867.000=-7.000
mean8.739-8.367=0.372
σ0.357-0.334=0.023
min8.460-7.998=0.462
max9.349-8.832=0.517
iters=5
new-facts=6402
prior-facts=6402
mean4945.218-4945.171=0.046
σ0.025-0.185=-0.160
min4945.184-4944.844=0.339
max4945.246-4945.294=-0.048
mean3052.400-3110.600=-58.200
σ255.442-253.283=2.159
min2860.000-2867.000=-7.000
max3450.000-3372.000=78.000
mean8.503-9.299=-0.797
σ0.222-0.898=-0.676
min8.344-8.394=-0.050
max8.873-10.294=-1.421

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.047-1.041=0.006
σ0.129-0.240=-0.110
min0.934-0.932=0.002
max1.251-1.469=-0.219

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.842-472.844=-0.002
σ574.927-574.930=-0.002
min185.370-185.375=-0.004
max1335.233-1335.238=-0.006
mean88.250
σ8.500
min84.000
max101.000
mean2860.000-2867.000=-7.000
σ0.000
min2860.000-2867.000=-7.000
max2860.000-2867.000=-7.000
mean0.450-0.492=-0.042
σ0.304-0.378=-0.074
min0.297-0.292=0.005
max0.906-1.059=-0.154
policies=20
mean1854.001-1854.016=-0.015
σ0.375-0.363=0.012
min1853.727-1853.733=-0.006
max1854.546-1854.541=0.005
mean840.000
σ0.000
min840.000
max840.000
mean2860.000-2867.000=-7.000
σ0.000
min2860.000-2867.000=-7.000
max2860.000-2867.000=-7.000
mean2.947-2.947=-0.001
σ0.013-0.004=0.008
min2.936-2.941=-0.005
max2.964-2.951=0.013
policies=200
mean18546.565-18546.636=-0.072
σ0.442-0.355=0.087
min18546.183-18546.320=-0.136
max18547.202-18547.143=0.060
mean8400.000
σ0.000
min8400.000
max8400.000
mean2860.000-2867.000=-7.000
σ0.000
min2860.000-2867.000=-7.000
max2860.000-2867.000=-7.000
mean29.051-29.085=-0.034
σ0.446-0.520=-0.074
min28.635-28.764=-0.129
max29.657-29.856=-0.199