Compare commits

Home / Compare eeae518a .. 809745b7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=0.001
σ0.055-0.056=-0.001
min35.593-35.591=0.002
max35.774-35.776=-0.002
mean415.100-412.000=3.100
σ0.316-0.000=0.316
min415.000-412.000=3.000
max416.000-412.000=4.000
mean0.085-0.085=0.000
σ0.004-0.003=0.001
min0.081-0.082=-0.001
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean24.047-24.047=0.000
σ0.003-0.004=-0.001
min24.044-24.042=0.003
max24.054-24.055=-0.000
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.067-0.067=0.001
σ0.002-0.004=-0.002
min0.066-0.062=0.004
max0.073-0.073=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.491=-0.002
σ0.365-0.365=-0.000
min1755.914-1755.919=-0.005
max1757.073-1757.080=-0.007
mean1652.550-1641.350=11.200
σ644.000-633.257=10.744
min633.000-619.000=14.000
max2837.000-2687.000=150.000
mean2.354-2.337=0.016
σ0.077-0.119=-0.042
min2.275-2.166=0.110
max2.542-2.603=-0.061

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.761-324.764=-0.003
σ0.055-0.041=0.014
min324.663-324.691=-0.028
max324.793-324.789=0.004
mean2837.000-2687.000=150.000
σ0.000
min2837.000-2687.000=150.000
max2837.000-2687.000=150.000
mean0.424-0.421=0.003
σ0.002-0.010=-0.008
min0.422-0.415=0.007
max0.427-0.439=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1985.325-1985.323=0.002
σ0.021-0.015=0.005
min1985.291-1985.303=-0.012
max1985.342-1985.339=0.002
mean2837.000-2687.000=150.000
σ0.000
min2837.000-2687.000=150.000
max2837.000-2687.000=150.000
mean2.579-2.573=0.006
σ0.074-0.117=-0.043
min2.511-2.421=0.090
max2.676-2.747=-0.071
iters=5
new-facts=6402
prior-facts=1
mean4809.086-4808.976=0.110
σ7.674-7.431=0.243
min4805.598-4805.582=0.016
max4822.814-4822.269=0.545
mean2837.000-2687.000=150.000
σ0.000
min2837.000-2687.000=150.000
max2837.000-2687.000=150.000
mean8.835-8.895=-0.060
σ0.164-0.190=-0.026
min8.635-8.714=-0.080
max8.984-9.110=-0.125
iters=5
new-facts=6402
prior-facts=6402
mean4996.558-4996.626=-0.068
σ0.167-0.028=0.139
min4996.261-4996.594=-0.333
max4996.656-4996.661=-0.004
mean3100.200-3006.000=94.200
σ256.506-364.598=-108.092
min2837.000-2687.000=150.000
max3349.000-3536.000=-187.000
mean8.933-8.444=0.489
σ0.378-0.082=0.296
min8.481-8.393=0.088
max9.511-8.590=0.921

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.050-1.000=0.050
σ0.171-0.065=0.106
min0.914-0.910=0.004
max1.334-1.058=0.276

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.212-463.210=0.002
σ574.773-574.769=0.004
min175.817-175.820=-0.003
max1325.372-1325.364=0.008
mean86.250
σ8.500
min82.000
max99.000
mean2837.000-2687.000=150.000
σ0.000
min2837.000-2687.000=150.000
max2837.000-2687.000=150.000
mean0.426-0.551=-0.126
σ0.293-0.557=-0.264
min0.276-0.272=0.004
max0.865-1.387=-0.522
policies=20
mean1758.517-1758.499=0.018
σ0.360-0.324=0.036
min1758.257-1758.289=-0.032
max1759.045-1758.982=0.063
mean820.000
σ0.000
min820.000
max820.000
mean2837.000-2687.000=150.000
σ0.000
min2837.000-2687.000=150.000
max2837.000-2687.000=150.000
mean2.818-2.708=0.110
σ0.035-0.010=0.025
min2.780-2.693=0.088
max2.859-2.714=0.146
policies=200
mean17592.112-17592.126=-0.014
σ0.438-0.484=-0.045
min17591.710-17591.807=-0.097
max17592.736-17592.845=-0.110
mean8200.000
σ0.000
min8200.000
max8200.000
mean2837.000-2687.000=150.000
σ0.000
min2837.000-2687.000=150.000
max2837.000-2687.000=150.000
mean28.022-27.480=0.542
σ0.372-0.124=0.247
min27.672-27.324=0.348
max28.488-27.602=0.887