Compare commits

Home / Compare bef12984 .. 542f43f4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.006-54.007=-0.001
σ0.367-0.367=0.000
min53.877-53.882=-0.004
max55.051-55.051=-0.000
mean418.000-418.800=-0.800
σ0.000-0.422=-0.422
min418.000
max418.000-419.000=-1.000
mean0.137-0.139=-0.002
σ0.004-0.004=0.001
min0.131-0.135=-0.005
max0.144-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.213-43.216=-0.003
σ0.005-0.012=-0.007
min43.205-43.208=-0.003
max43.222-43.248=-0.026
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.120-0.121=-0.000
σ0.003-0.002=0.001
min0.118-0.119=-0.001
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.362-992.357=0.006
σ1.309-1.277=0.032
min991.805-991.809=-0.004
max997.880-997.738=0.142
mean1068.750-1073.250=-4.500
σ313.709-318.157=-4.448
min591.000-571.000=20.000
max1646.000-1648.000=-2.000
mean1.525-1.538=-0.013
σ0.120-0.077=0.043
min1.393-1.463=-0.070
max1.985-1.722=0.263

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean287.358-287.355=0.002
σ0.012-0.008=0.004
min287.337-287.342=-0.004
max287.369-287.362=0.007
mean1646.000-1648.000=-2.000
σ0.000
min1646.000-1648.000=-2.000
max1646.000-1648.000=-2.000
mean0.373-0.370=0.003
σ0.005-0.004=0.001
min0.368-0.368=0.001
max0.379-0.378=0.001
iters=5
new-facts=1
prior-facts=6402
mean1287.325-1287.311=0.014
σ0.139-0.105=0.034
min1287.258-1287.258=0.000
max1287.574-1287.498=0.075
mean1646.000-1648.000=-2.000
σ0.000
min1646.000-1648.000=-2.000
max1646.000-1648.000=-2.000
mean1.857-1.884=-0.028
σ0.052-0.080=-0.028
min1.795-1.772=0.023
max1.911-1.980=-0.069
iters=5
new-facts=6402
prior-facts=1
mean1809.658-1809.705=-0.047
σ7.002-6.966=0.036
min1806.293-1806.351=-0.058
max1822.170-1822.150=0.020
mean1646.000-1648.000=-2.000
σ0.000
min1646.000-1648.000=-2.000
max1646.000-1648.000=-2.000
mean4.133-4.337=-0.204
σ0.299-0.180=0.118
min3.764-4.128=-0.364
max4.470-4.558=-0.088
iters=5
new-facts=6402
prior-facts=6402
mean2072.169-2072.159=0.010
σ0.044-0.008=0.036
min2072.133-2072.149=-0.016
max2072.245-2072.170=0.075
mean1862.200-1849.800=12.400
σ196.565-172.523=24.042
min1646.000-1648.000=-2.000
max2088.000-2092.000=-4.000
mean5.100-4.925=0.175
σ0.235-0.040=0.195
min4.867-4.885=-0.018
max5.477-4.991=0.485

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.314-1.208=0.106
σ0.349-0.380=-0.031
min1.033-0.902=0.131
max1.817-1.854=-0.038

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.414-437.414=-0.000
σ572.403-572.401=0.002
min151.206-151.202=0.003
max1296.018-1296.015=0.002
mean90.250
σ8.500
min86.000
max103.000
mean1646.000-1648.000=-2.000
σ0.000
min1646.000-1648.000=-2.000
max1646.000-1648.000=-2.000
mean0.528-0.556=-0.028
σ0.552-0.608=-0.056
min0.249-0.248=0.001
max1.355-1.467=-0.112
policies=20
mean1512.301-1512.320=-0.019
σ0.245-0.241=0.004
min1512.138-1512.164=-0.025
max1512.666-1512.680=-0.014
mean860.000
σ0.000
min860.000
max860.000
mean1646.000-1648.000=-2.000
σ0.000
min1646.000-1648.000=-2.000
max1646.000-1648.000=-2.000
mean2.522-2.521=0.002
σ0.005-0.008=-0.003
min2.517-2.511=0.005
max2.528-2.531=-0.003
policies=200
mean15130.861-15130.877=-0.016
σ0.074-0.066=0.008
min15130.801-15130.799=0.002
max15130.968-15130.961=0.007
mean8600.000
σ0.000
min8600.000
max8600.000
mean1646.000-1648.000=-2.000
σ0.000
min1646.000-1648.000=-2.000
max1646.000-1648.000=-2.000
mean25.467-25.609=-0.142
σ0.130-0.146=-0.017
min25.339-25.460=-0.121
max25.607-25.791=-0.184