Compare commits

Home / Compare ebd26ca0 .. f29e369c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.646-53.648=-0.002
σ0.367-0.369=-0.002
min53.513-53.510=0.004
max54.688-54.697=-0.008
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.137-0.138=-0.001
σ0.004-0.006=-0.002
min0.132-0.129=0.004
max0.144-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean42.942-42.943=-0.001
σ0.007-0.006=0.001
min42.932-42.933=-0.000
max42.956-42.950=0.006
mean417.000-413.800=3.200
σ0.000-0.422=-0.422
min417.000-413.000=4.000
max417.000-414.000=3.000
mean0.118-0.119=-0.001
σ0.003-0.004=-0.001
min0.114-0.114=0.000
max0.126-0.126=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.865-991.797=0.068
σ1.222-1.240=-0.019
min991.271-991.223=0.049
max996.968-997.017=-0.050
mean1072.850-1069.750=3.100
σ328.970-314.730=14.240
min580.000-614.000=-34.000
max1656.000-1653.000=3.000
mean1.564-1.514=0.050
σ0.155-0.057=0.098
min1.464-1.452=0.012
max2.159-1.662=0.497

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.442-285.389=0.053
σ0.008-0.013=-0.004
min285.428-285.369=0.059
max285.451-285.402=0.049
mean1656.000-1653.000=3.000
σ0.000
min1656.000-1653.000=3.000
max1656.000-1653.000=3.000
mean0.386-0.370=0.017
σ0.015-0.004=0.011
min0.376-0.365=0.010
max0.412-0.377=0.035
iters=5
new-facts=1
prior-facts=6402
mean1285.494-1285.353=0.140
σ0.085-0.132=-0.047
min1285.348-1285.285=0.062
max1285.567-1285.589=-0.022
mean1656.000-1653.000=3.000
σ0.000
min1656.000-1653.000=3.000
max1656.000-1653.000=3.000
mean1.899-1.913=-0.014
σ0.034-0.150=-0.116
min1.859-1.787=0.072
max1.941-2.174=-0.233
iters=5
new-facts=6402
prior-facts=1
mean1705.834-1807.688=-101.854
σ6.863-6.990=-0.128
min1702.648-1804.306=-101.657
max1718.107-1820.174=-102.067
mean1656.000-1653.000=3.000
σ0.000
min1656.000-1653.000=3.000
max1656.000-1653.000=3.000
mean3.102-4.174=-1.073
σ0.328-0.196=0.132
min2.813-3.913=-1.100
max3.641-4.387=-0.746
iters=5
new-facts=6402
prior-facts=6402
mean1968.382-2070.178=-101.796
σ0.052-0.008=0.044
min1968.335-2070.167=-101.832
max1968.446-2070.190=-101.744
mean1794.400-1847.800=-53.400
σ140.884-178.622=-37.738
min1656.000-1653.000=3.000
max1983.000-2081.000=-98.000
mean3.268-4.517=-1.249
σ0.416-0.049=0.367
min3.059-4.455=-1.396
max4.011-4.571=-0.560

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.141-1.207=-0.066
σ0.287-0.368=-0.080
min0.908-0.911=-0.003
max1.610-1.786=-0.176

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.775-436.776=-0.001
σ572.366-572.361=0.005
min150.590-150.590=0.000
max1295.324-1295.318=0.006
mean90.250
σ8.500
min86.000
max103.000
mean1656.000-1653.000=3.000
σ0.000
min1656.000-1653.000=3.000
max1656.000-1653.000=3.000
mean0.531-0.512=0.019
σ0.561-0.522=0.038
min0.249-0.247=0.002
max1.372-1.296=0.076
policies=20
mean1506.193-1506.191=0.001
σ0.245-0.245=-0.000
min1506.043-1506.036=0.007
max1506.558-1506.556=0.002
mean860.000
σ0.000
min860.000
max860.000
mean1656.000-1653.000=3.000
σ0.000
min1656.000-1653.000=3.000
max1656.000-1653.000=3.000
mean2.533-2.526=0.008
σ0.032-0.016=0.016
min2.506-2.509=-0.003
max2.571-2.543=0.028
policies=200
mean15069.453-15069.554=-0.101
σ0.108-0.047=0.061
min15069.345-15069.492=-0.147
max15069.601-15069.607=-0.006
mean8600.000
σ0.000
min8600.000
max8600.000
mean1656.000-1653.000=3.000
σ0.000
min1656.000-1653.000=3.000
max1656.000-1653.000=3.000
mean25.545-25.581=-0.037
σ0.135-0.212=-0.078
min25.416-25.315=0.101
max25.698-25.784=-0.086