Compare commits

Home / Compare 7c4440cf .. 71ae7d66

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.701=-0.000
σ0.048-0.047=0.002
min70.668-70.669=-0.002
max70.834-70.830=0.004
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.157-0.157=0.000
σ0.003-0.004=-0.001
min0.155-0.152=0.004
max0.163-0.163=0.000
cache=y
dps=1
iters=10
policies=100
mean21.408-21.409=-0.001
σ0.003-0.003=-0.000
min21.402-21.405=-0.003
max21.411-21.413=-0.002
mean411.500-415.000=-3.500
σ0.527-0.000=0.527
min411.000-415.000=-4.000
max412.000-415.000=-3.000
mean0.061-0.063=-0.003
σ0.003-0.003=-0.000
min0.059-0.060=-0.001
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.930=0.002
σ0.361-0.362=-0.001
min1754.364-1754.365=-0.001
max1755.513-1755.514=-0.001
mean1663.450-1657.700=5.750
σ619.541-622.928=-3.387
min621.000-638.000=-17.000
max2495.000-2509.000=-14.000
mean2.790-2.781=0.009
σ0.199-0.196=0.003
min2.256-2.264=-0.007
max2.948-3.111=-0.163

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.791-272.792=-0.001
σ0.005-0.007=-0.002
min272.785-272.784=0.001
max272.797-272.799=-0.002
mean2495.000-2509.000=-14.000
σ0.000
min2495.000-2509.000=-14.000
max2495.000-2509.000=-14.000
mean0.381-0.384=-0.003
σ0.008-0.007=0.001
min0.377-0.379=-0.002
max0.395-0.397=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.218-1933.220=-0.003
σ0.005-0.013=-0.008
min1933.212-1933.205=0.006
max1933.225-1933.234=-0.010
mean2495.000-2509.000=-14.000
σ0.000
min2495.000-2509.000=-14.000
max2495.000-2509.000=-14.000
mean3.020-2.989=0.032
σ0.059-0.097=-0.038
min2.979-2.887=0.092
max3.121-3.138=-0.017
iters=5
new-facts=6402
prior-facts=1
mean4756.865-4756.892=-0.027
σ7.611-7.635=-0.025
min4752.930-4753.177=-0.246
max4770.467-4770.546=-0.079
mean2495.000-2509.000=-14.000
σ0.000
min2495.000-2509.000=-14.000
max2495.000-2509.000=-14.000
mean8.431-8.466=-0.035
σ0.417-0.605=-0.188
min7.891-7.627=0.265
max8.910-9.007=-0.098
iters=5
new-facts=6402
prior-facts=6402
mean4944.389-4944.456=-0.066
σ0.153-0.013=0.140
min4944.116-4944.442=-0.326
max4944.472-4944.469=0.003
mean2979.200-3013.600=-34.400
σ273.794-306.899=-33.105
min2607.000-2599.000=8.000
max3317.000-3401.000=-84.000
mean8.512-8.550=-0.038
σ0.068-0.101=-0.033
min8.428-8.428=-0.001
max8.581-8.648=-0.067

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.570-1.582=-0.012
σ0.257-0.210=0.047
min1.233-1.245=-0.012
max1.763-1.798=-0.035

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.302-468.308=-0.006
σ574.227-574.231=-0.004
min181.183-181.187=-0.004
max1329.643-1329.655=-0.012
mean88.250
σ8.500
min84.000
max101.000
mean2495.000-2509.000=-14.000
σ0.000
min2495.000-2509.000=-14.000
max2495.000-2509.000=-14.000
mean0.563-0.568=-0.005
σ0.561-0.567=-0.006
min0.281-0.282=-0.001
max1.405-1.419=-0.014
policies=20
mean1812.145-1812.189=-0.044
σ0.388-0.400=-0.012
min1811.885-1811.915=-0.031
max1812.719-1812.778=-0.060
mean840.000
σ0.000
min840.000
max840.000
mean2495.000-2509.000=-14.000
σ0.000
min2495.000-2509.000=-14.000
max2495.000-2509.000=-14.000
mean2.825-2.850=-0.025
σ0.012-0.021=-0.009
min2.808-2.832=-0.025
max2.832-2.874=-0.042
policies=200
mean18128.960-18129.029=-0.069
σ0.549-0.452=0.097
min18128.504-18128.699=-0.195
max18129.754-18129.698=0.056
mean8400.000
σ0.000
min8400.000
max8400.000
mean2495.000-2509.000=-14.000
σ0.000
min2495.000-2509.000=-14.000
max2495.000-2509.000=-14.000
mean28.347-28.635=-0.288
σ0.035-0.072=-0.037
min28.318-28.533=-0.215
max28.392-28.691=-0.299