Compare commits

Home / Compare 34c224a3 .. da1b682e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=-0.000
σ0.366-0.369=-0.002
min53.781-53.790=-0.009
max54.956-54.963=-0.006
mean414.200-417.000=-2.800
σ1.033-0.000=1.033
min413.000-417.000=-4.000
max415.000-417.000=-2.000
mean0.140-0.137=0.003
σ0.004-0.004=-0.001
min0.136-0.131=0.004
max0.147-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.142-43.141=0.001
σ0.005-0.005=0.001
min43.133-43.135=-0.002
max43.149-43.149=-0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.121-0.121=-0.000
σ0.003-0.003=0.000
min0.118-0.118=0.000
max0.127-0.127=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.136-992.141=-0.005
σ1.185-1.185=-0.001
min991.590-991.584=0.006
max997.098-997.110=-0.012
mean1056.150-1066.800=-10.650
σ312.399-319.935=-7.535
min588.000-599.000=-11.000
max1531.000-1641.000=-110.000
mean1.499-1.524=-0.025
σ0.057-0.083=-0.026
min1.384-1.396=-0.012
max1.582-1.736=-0.154

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.717-285.720=-0.002
σ0.010-0.011=-0.002
min285.706-285.701=0.006
max285.731-285.731=-0.000
mean1531.000-1641.000=-110.000
σ0.000
min1531.000-1641.000=-110.000
max1531.000-1641.000=-110.000
mean0.379-0.380=-0.001
σ0.005-0.006=-0.002
min0.375-0.375=0.000
max0.384-0.390=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1285.735-1285.786=-0.050
σ0.034-0.086=-0.052
min1285.687-1285.635=0.052
max1285.768-1285.844=-0.075
mean1531.000-1641.000=-110.000
σ0.000
min1531.000-1641.000=-110.000
max1531.000-1641.000=-110.000
mean1.855-1.901=-0.046
σ0.032-0.126=-0.094
min1.822-1.789=0.032
max1.894-2.087=-0.193
iters=5
new-facts=6402
prior-facts=1
mean1696.115-1696.110=0.005
σ6.845-6.847=-0.001
min1692.937-1692.938=-0.001
max1708.358-1708.355=0.002
mean1531.000-1641.000=-110.000
σ0.000
min1531.000-1641.000=-110.000
max1531.000-1641.000=-110.000
mean2.832-2.919=-0.087
σ0.256-0.242=0.014
min2.476-2.584=-0.109
max3.169-3.233=-0.064
iters=5
new-facts=6402
prior-facts=6402
mean1958.718-1958.710=0.008
σ0.015-0.008=0.007
min1958.705-1958.702=0.003
max1958.744-1958.720=0.024
mean1862.800-1800.400=62.400
σ250.286-176.606=73.680
min1573.000-1641.000=-68.000
max2185.000-2050.000=135.000
mean3.204-3.154=0.051
σ0.096-0.049=0.047
min3.109-3.111=-0.002
max3.344-3.229=0.114

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.622-1.199=0.423
σ0.209-0.275=-0.065
min1.345-0.904=0.441
max1.858-1.632=0.227

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.375-437.383=-0.008
σ572.351-572.360=-0.009
min151.195-151.194=0.001
max1295.901-1295.923=-0.022
mean90.250
σ8.500
min86.000
max103.000
mean1531.000-1641.000=-110.000
σ0.000
min1531.000-1641.000=-110.000
max1531.000-1641.000=-110.000
mean0.537-0.538=-0.001
σ0.563-0.560=0.004
min0.251-0.257=-0.007
max1.383-1.378=0.005
policies=20
mean1512.205-1512.194=0.011
σ0.247-0.255=-0.008
min1512.036-1512.032=0.004
max1512.572-1512.575=-0.003
mean860.000
σ0.000
min860.000
max860.000
mean1531.000-1641.000=-110.000
σ0.000
min1531.000-1641.000=-110.000
max1531.000-1641.000=-110.000
mean2.524-2.535=-0.011
σ0.027-0.016=0.011
min2.484-2.514=-0.030
max2.539-2.553=-0.013
policies=200
mean15129.606-15129.502=0.104
σ0.121-0.063=0.058
min15129.494-15129.408=0.086
max15129.771-15129.541=0.229
mean8600.000
σ0.000
min8600.000
max8600.000
mean1531.000-1641.000=-110.000
σ0.000
min1531.000-1641.000=-110.000
max1531.000-1641.000=-110.000
mean25.618-25.599=0.019
σ0.110-0.147=-0.037
min25.479-25.453=0.026
max25.730-25.780=-0.050