Compare commits

Home / Compare 3147d3d5 .. 331c3502

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.695-70.696=-0.001
σ0.047-0.047=-0.001
min70.669-70.666=0.003
max70.826-70.829=-0.003
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.161-0.158=0.003
σ0.002-0.004=-0.001
min0.157-0.152=0.006
max0.164-0.161=0.003
cache=y
dps=1
iters=10
policies=100
mean21.423-21.420=0.003
σ0.010-0.003=0.007
min21.413-21.414=-0.001
max21.450-21.424=0.027
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.063-0.065=-0.002
σ0.003-0.003=0.000
min0.060-0.062=-0.002
max0.070-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.459=-0.002
σ0.363-0.360=0.003
min1753.896-1753.890=0.006
max1755.038-1755.060=-0.021
mean1657.400-1658.250=-0.850
σ638.182-627.157=11.024
min636.000-623.000=13.000
max2837.000
mean2.763-2.817=-0.054
σ0.212-0.193=0.019
min2.278-2.383=-0.105
max3.047-3.256=-0.209

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.504-273.499=0.006
σ0.005-0.017=-0.011
min273.497-273.475=0.022
max273.512-273.515=-0.004
mean2837.000
σ0.000
min2837.000
max2837.000
mean0.381-0.384=-0.003
σ0.008-0.001=0.007
min0.375-0.383=-0.008
max0.394-0.386=0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.891-1933.897=-0.005
σ0.006-0.012=-0.006
min1933.887-1933.885=0.002
max1933.901-1933.912=-0.012
mean2837.000
σ0.000
min2837.000
max2837.000
mean2.958-2.834=0.124
σ0.068-0.196=-0.128
min2.858-2.495=0.362
max3.035-2.992=0.043
iters=5
new-facts=6402
prior-facts=1
mean4754.515-4754.564=-0.049
σ0.701-0.983=-0.283
min4754.141-4753.781=0.359
max4755.763-4756.277=-0.514
mean2837.000
σ0.000
min2837.000
max2837.000
mean8.857-8.590=0.267
σ0.423-0.439=-0.016
min8.343-7.931=0.411
max9.459-9.072=0.387
iters=5
new-facts=6402
prior-facts=6402
mean4944.978-4945.048=-0.070
σ0.325-0.167=0.158
min4944.397-4944.753=-0.356
max4945.145-4945.152=-0.006
mean3050.200-3058.600=-8.400
σ207.323-232.355=-25.032
min2837.000
max3309.000-3393.000=-84.000
mean8.693-8.563=0.131
σ0.231-0.252=-0.021
min8.374-8.323=0.051
max8.912-8.983=-0.072

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-0.999=0.024
σ0.193-0.142=0.051
min0.932-0.934=-0.002
max1.368-1.253=0.115

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.102-473.100=0.002
σ575.910-575.912=-0.002
min185.139-185.134=0.005
max1336.967-1336.967=-0.000
mean88.250
σ8.500
min84.000
max101.000
mean2837.000
σ0.000
min2837.000
max2837.000
mean0.490-0.487=0.003
σ0.377-0.375=0.002
min0.298-0.299=-0.000
max1.056-1.050=0.006
policies=20
mean1851.685-1851.669=0.016
σ0.373-0.373=0.000
min1851.398-1851.386=0.011
max1852.226-1852.212=0.014
mean840.000
σ0.000
min840.000
max840.000
mean2837.000
σ0.000
min2837.000
max2837.000
mean2.948-2.953=-0.005
σ0.009-0.008=0.001
min2.937-2.946=-0.008
max2.958-2.963=-0.005
policies=200
mean18522.318-18522.479=-0.161
σ0.795-0.583=0.212
min18521.370-18521.689=-0.319
max18523.256-18523.083=0.173
mean8400.000
σ0.000
min8400.000
max8400.000
mean2837.000
σ0.000
min2837.000
max2837.000
mean29.187-29.204=-0.017
σ0.415-0.544=-0.129
min28.826-28.729=0.097
max29.653-29.895=-0.242