Compare commits

Home / Compare 85972c69 .. e63417db

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-73.045=-37.802
σ0.051-0.046=0.005
min35.218-73.025=-37.807
max35.387-73.175=-37.788
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.086-0.159=-0.073
σ0.004-0.004=-0.001
min0.082-0.151=-0.069
max0.093-0.165=-0.072
cache=y
dps=1
iters=10
policies=100
mean23.770-23.741=0.029
σ0.002-0.003=-0.001
min23.767-23.736=0.031
max23.773-23.746=0.027
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.069-0.065=0.004
σ0.003-0.003=-0.000
min0.066-0.061=0.005
max0.076-0.073=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1758.786=-2.302
σ0.365-0.362=0.003
min1755.913-1758.216=-2.303
max1757.063-1759.370=-2.307
mean1658.250-1622.700=35.550
σ642.350-593.451=48.899
min631.000-625.000=6.000
max2800.000-2413.000=387.000
mean2.333-2.782=-0.450
σ0.145-0.157=-0.012
min2.097-2.303=-0.206
max2.786-3.019=-0.233

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.692-324.010=0.681
σ0.048-0.056=-0.008
min324.609-323.910=0.699
max324.732-324.045=0.687
mean2800.000-2413.000=387.000
σ0.000
min2800.000-2413.000=387.000
max2800.000-2413.000=387.000
mean0.431-0.427=0.004
σ0.011-0.001=0.010
min0.423-0.427=-0.004
max0.448-0.428=0.019
iters=5
new-facts=1
prior-facts=6402
mean1985.262-1984.572=0.690
σ0.009-0.021=-0.012
min1985.247-1984.547=0.700
max1985.269-1984.599=0.670
mean2800.000-2413.000=387.000
σ0.000
min2800.000-2413.000=387.000
max2800.000-2413.000=387.000
mean2.640-2.671=-0.031
σ0.059-0.185=-0.126
min2.590-2.493=0.097
max2.715-2.875=-0.160
iters=5
new-facts=6402
prior-facts=1
mean4808.774-4808.234=0.540
σ7.783-7.769=0.014
min4804.838-4804.742=0.096
max4822.688-4822.132=0.556
mean2800.000-2413.000=387.000
σ0.000
min2800.000-2413.000=387.000
max2800.000-2413.000=387.000
mean9.114-8.797=0.317
σ0.179-0.174=0.004
min8.900-8.642=0.257
max9.366-8.990=0.376
iters=5
new-facts=6402
prior-facts=6402
mean4996.437-4995.736=0.701
σ0.070-0.171=-0.101
min4996.317-4995.431=0.886
max4996.492-4995.826=0.666
mean2989.200-2962.600=26.600
σ202.097-274.552=-72.455
min2800.000-2594.000=206.000
max3291.000-3327.000=-36.000
mean8.687-8.695=-0.008
σ0.157-0.122=0.035
min8.473-8.515=-0.042
max8.899-8.837=0.063

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.949-1.578=-0.629
σ0.051-0.070=-0.019
min0.919-1.493=-0.574
max1.040-1.665=-0.626

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.964-468.326=-5.362
σ574.250-574.236=0.014
min175.833-181.206=-5.373
max1324.338-1329.680=-5.342
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2800.000-2413.000=387.000
σ0.000
min2800.000-2413.000=387.000
max2800.000-2413.000=387.000
mean0.430-0.560=-0.129
σ0.302-0.547=-0.244
min0.278-0.282=-0.004
max0.883-1.379=-0.496
policies=20
mean1758.685-1812.425=-53.741
σ0.327-0.397=-0.070
min1758.470-1812.144=-53.674
max1759.170-1813.009=-53.839
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2800.000-2413.000=387.000
σ0.000
min2800.000-2413.000=387.000
max2800.000-2413.000=387.000
mean2.832-2.863=-0.032
σ0.077-0.067=0.010
min2.781-2.805=-0.024
max2.946-2.948=-0.002
policies=200
mean17592.425-18131.614=-539.189
σ0.542-0.534=0.008
min17592.064-18131.206=-539.142
max17593.231-18132.383=-539.151
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2800.000-2413.000=387.000
σ0.000
min2800.000-2413.000=387.000
max2800.000-2413.000=387.000
mean27.493-28.327=-0.834
σ0.117-0.078=0.039
min27.388-28.232=-0.843
max27.603-28.415=-0.812