Compare commits

Home / Compare 63f94cd8 .. 82be9b55

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.647=0.001
σ0.367-0.368=-0.001
min53.520-53.523=-0.003
max54.692-54.696=-0.003
mean419.300-417.700=1.600
σ0.483
min419.000-417.000=2.000
max420.000-418.000=2.000
mean0.139-0.139=0.000
σ0.004-0.003=0.000
min0.136-0.136=0.000
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean42.941-42.941=-0.000
σ0.005-0.006=-0.001
min42.933-42.930=0.002
max42.948-42.951=-0.003
mean420.000-418.800=1.200
σ0.000-0.422=-0.422
min420.000-418.000=2.000
max420.000-419.000=1.000
mean0.117-0.118=-0.001
σ0.004-0.004=-0.000
min0.113-0.113=0.000
max0.124-0.125=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.864-991.864=0.001
σ1.207-1.207=-0.000
min991.331-991.332=-0.002
max996.918-996.919=-0.001
mean1067.000-1065.050=1.950
σ318.964-313.507=5.457
min595.000-604.000=-9.000
max1558.000-1601.000=-43.000
mean1.537-1.521=0.016
σ0.067-0.079=-0.012
min1.460-1.430=0.030
max1.652-1.799=-0.147

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.436-285.438=-0.002
σ0.010-0.014=-0.004
min285.421-285.417=0.004
max285.447-285.452=-0.005
mean1558.000-1601.000=-43.000
σ0.000
min1558.000-1601.000=-43.000
max1558.000-1601.000=-43.000
mean0.380-0.385=-0.005
σ0.008-0.015=-0.007
min0.374-0.374=0.000
max0.389-0.406=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1285.515-1285.528=-0.013
σ0.092-0.040=0.052
min1285.351-1285.462=-0.111
max1285.565-1285.561=0.004
mean1558.000-1601.000=-43.000
σ0.000
min1558.000-1601.000=-43.000
max1558.000-1601.000=-43.000
mean2.008-1.896=0.112
σ0.213-0.142=0.071
min1.827-1.803=0.024
max2.322-2.136=0.186
iters=5
new-facts=6402
prior-facts=1
mean1705.821-1705.828=-0.007
σ6.862-6.877=-0.015
min1702.598-1702.625=-0.026
max1718.093-1718.126=-0.033
mean1558.000-1601.000=-43.000
σ0.000
min1558.000-1601.000=-43.000
max1558.000-1601.000=-43.000
mean3.223-2.959=0.264
σ0.216-0.333=-0.118
min2.937-2.563=0.374
max3.427-3.320=0.108
iters=5
new-facts=6402
prior-facts=6402
mean1968.412-1968.461=-0.049
σ0.032-0.028=0.005
min1968.355-1968.413=-0.058
max1968.431-1968.482=-0.050
mean1808.200-1806.600=1.600
σ227.405-170.088=57.318
min1558.000-1601.000=-43.000
max2124.000-2030.000=94.000
mean3.367-3.455=-0.088
σ0.376-0.252=0.125
min3.131-3.134=-0.003
max4.035-3.761=0.274

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.566-1.446=0.120
σ0.262-0.412=-0.150
min1.226-0.989=0.237
max1.801-1.834=-0.033

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.765-436.772=-0.007
σ572.352-572.358=-0.006
min150.586-150.590=-0.004
max1295.293-1295.310=-0.017
mean90.250
σ8.500
min86.000
max103.000
mean1558.000-1601.000=-43.000
σ0.000
min1558.000-1601.000=-43.000
max1558.000-1601.000=-43.000
mean0.525-0.536=-0.011
σ0.550-0.579=-0.029
min0.249-0.239=0.010
max1.350-1.405=-0.055
policies=20
mean1506.166-1506.177=-0.011
σ0.250-0.242=0.008
min1505.995-1506.020=-0.025
max1506.537-1506.537=0.000
mean860.000
σ0.000
min860.000
max860.000
mean1558.000-1601.000=-43.000
σ0.000
min1558.000-1601.000=-43.000
max1558.000-1601.000=-43.000
mean2.533-2.517=0.015
σ0.023-0.015=0.008
min2.503-2.500=0.003
max2.559-2.537=0.022
policies=200
mean15069.476-15069.448=0.028
σ0.103-0.073=0.030
min15069.388-15069.354=0.035
max15069.588-15069.532=0.056
mean8600.000
σ0.000
min8600.000
max8600.000
mean1558.000-1601.000=-43.000
σ0.000
min1558.000-1601.000=-43.000
max1558.000-1601.000=-43.000
mean25.507-25.459=0.048
σ0.088-0.184=-0.096
min25.415-25.276=0.139
max25.588-25.692=-0.104