Compare commits

Home / Compare 6548c2b5 .. 871da712

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.649-53.646=0.003
σ0.364-0.367=-0.003
min53.521-53.516=0.006
max54.685-54.690=-0.005
mean418.600-414.600=4.000
σ0.516
min418.000-414.000=4.000
max419.000-415.000=4.000
mean0.140-0.136=0.004
σ0.004-0.005=-0.002
min0.136-0.127=0.008
max0.147-0.144=0.004
cache=y
dps=1
iters=10
policies=100
mean42.941-42.942=-0.000
σ0.006-0.006=-0.000
min42.933-42.932=0.001
max42.953-42.951=0.002
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.121-0.121=0.000
σ0.003-0.003=-0.000
min0.119-0.118=0.001
max0.127-0.127=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.864-991.810=0.054
σ1.210-1.240=-0.030
min991.331-991.222=0.108
max996.929-997.015=-0.086
mean1059.850-1071.350=-11.500
σ313.143-319.412=-6.270
min592.000-613.000=-21.000
max1534.000-1634.000=-100.000
mean1.516-1.511=0.005
σ0.061-0.058=0.002
min1.453-1.347=0.106
max1.648-1.608=0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.436-285.386=0.050
σ0.012-0.011=0.001
min285.423-285.371=0.052
max285.451-285.398=0.053
mean1534.000-1634.000=-100.000
σ0.000
min1534.000-1634.000=-100.000
max1534.000-1634.000=-100.000
mean0.379-0.375=0.004
σ0.005-0.010=-0.005
min0.375-0.366=0.009
max0.388-0.386=0.002
iters=5
new-facts=1
prior-facts=6402
mean1285.465-1285.351=0.114
σ0.073-0.130=-0.057
min1285.357-1285.287=0.071
max1285.537-1285.584=-0.048
mean1534.000-1634.000=-100.000
σ0.000
min1534.000-1634.000=-100.000
max1534.000-1634.000=-100.000
mean1.883-1.942=-0.058
σ0.181-0.164=0.016
min1.687-1.850=-0.163
max2.170-2.235=-0.064
iters=5
new-facts=6402
prior-facts=1
mean1705.829-1807.667=-101.838
σ6.849-7.014=-0.165
min1702.644-1804.316=-101.671
max1718.078-1820.198=-102.119
mean1534.000-1634.000=-100.000
σ0.000
min1534.000-1634.000=-100.000
max1534.000-1634.000=-100.000
mean2.913-4.149=-1.236
σ0.258-0.185=0.073
min2.560-3.983=-1.423
max3.177-4.445=-1.268
iters=5
new-facts=6402
prior-facts=6402
mean1968.451-2070.180=-101.729
σ0.015-0.007=0.007
min1968.436-2070.168=-101.732
max1968.471-2070.187=-101.716
mean1855.200-1832.400=22.800
σ233.318-170.638=62.680
min1567.000-1634.000=-67.000
max2139.000-2068.000=71.000
mean3.264-4.588=-1.324
σ0.112-0.082=0.030
min3.148-4.504=-1.356
max3.429-4.720=-1.291

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.533-1.206=0.326
σ0.232-0.327=-0.095
min1.231-0.914=0.317
max1.836-1.757=0.079

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.769-436.774=-0.004
σ572.351-572.365=-0.014
min150.587-150.586=0.002
max1295.296-1295.322=-0.026
mean90.250
σ8.500
min86.000
max103.000
mean1534.000-1634.000=-100.000
σ0.000
min1534.000-1634.000=-100.000
max1534.000-1634.000=-100.000
mean0.533-0.521=0.012
σ0.558-0.541=0.017
min0.251-0.250=0.001
max1.369-1.332=0.037
policies=20
mean1506.155-1506.155=0.000
σ0.245-0.233=0.012
min1505.990-1505.997=-0.007
max1506.518-1506.500=0.018
mean860.000
σ0.000
min860.000
max860.000
mean1534.000-1634.000=-100.000
σ0.000
min1534.000-1634.000=-100.000
max1534.000-1634.000=-100.000
mean2.525-2.507=0.018
σ0.018-0.018=0.000
min2.502-2.484=0.018
max2.540-2.525=0.015
policies=200
mean15069.474-15069.487=-0.013
σ0.115-0.111=0.004
min15069.367-15069.357=0.010
max15069.594-15069.591=0.003
mean8600.000
σ0.000
min8600.000
max8600.000
mean1534.000-1634.000=-100.000
σ0.000
min1534.000-1634.000=-100.000
max1534.000-1634.000=-100.000
mean25.490-25.457=0.033
σ0.114-0.085=0.029
min25.387-25.357=0.030
max25.619-25.541=0.078