Compare commits

Home / Compare aaf4e113 .. 338eb823

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.611-35.613=-0.002
σ0.054-0.054=-0.000
min35.582-35.584=-0.002
max35.764-35.767=-0.002
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.085-0.085=-0.000
σ0.004-0.004=0.000
min0.082-0.082=-0.000
max0.094-0.092=0.002
cache=y
dps=1
iters=10
policies=100
mean24.040-24.041=-0.000
σ0.002-0.003=-0.000
min24.036-24.038=-0.002
max24.044-24.045=-0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.068-0.065=0.003
σ0.003-0.004=-0.001
min0.066-0.061=0.004
max0.075-0.075=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.495-1756.495=-0.000
σ0.364-0.365=-0.001
min1755.922-1755.921=0.001
max1757.080-1757.079=0.001
mean1649.200-1654.400=-5.200
σ639.599-623.003=16.596
min625.000-670.000=-45.000
max2834.000-2683.000=151.000
mean2.407-2.371=0.036
σ0.168-0.098=0.071
min2.285-2.258=0.028
max2.976-2.625=0.351

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.767-324.771=-0.004
σ0.056-0.054=0.002
min324.668-324.675=-0.008
max324.795-324.802=-0.007
mean2834.000-2683.000=151.000
σ0.000
min2834.000-2683.000=151.000
max2834.000-2683.000=151.000
mean0.422-0.428=-0.005
σ0.008-0.009=-0.001
min0.418-0.421=-0.003
max0.436-0.439=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.329-1985.324=0.005
σ0.014-0.017=-0.004
min1985.306-1985.293=0.013
max1985.341-1985.335=0.006
mean2834.000-2683.000=151.000
σ0.000
min2834.000-2683.000=151.000
max2834.000-2683.000=151.000
mean2.663-2.644=0.019
σ0.122-0.069=0.053
min2.568-2.594=-0.025
max2.826-2.740=0.086
iters=5
new-facts=6402
prior-facts=1
mean4810.235-4810.082=0.153
σ7.610-7.747=-0.137
min4806.765-4806.286=0.479
max4823.849-4823.935=-0.086
mean2834.000-2683.000=151.000
σ0.000
min2834.000-2683.000=151.000
max2834.000-2683.000=151.000
mean8.012-8.383=-0.371
σ0.282-0.637=-0.355
min7.728-7.671=0.057
max8.450-9.074=-0.624
iters=5
new-facts=6402
prior-facts=6402
mean4997.704-4997.696=0.009
σ0.028-0.055=-0.027
min4997.670-4997.607=0.063
max4997.731-4997.733=-0.002
mean3041.000-3004.200=36.800
σ283.538-364.562=-81.023
min2834.000-2683.000=151.000
max3487.000-3533.000=-46.000
mean8.470-8.553=-0.083
σ0.124-0.152=-0.028
min8.371-8.443=-0.072
max8.685-8.814=-0.130

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.946-1.032=-0.086
σ0.056-0.133=-0.078
min0.915-0.917=-0.003
max1.045-1.243=-0.199

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.217-463.223=-0.006
σ574.767-574.770=-0.003
min175.830-175.831=-0.001
max1325.367-1325.378=-0.011
mean86.250
σ8.500
min82.000
max99.000
mean2834.000-2683.000=151.000
σ0.000
min2834.000-2683.000=151.000
max2834.000-2683.000=151.000
mean0.428-0.546=-0.118
σ0.295-0.543=-0.247
min0.278-0.273=0.005
max0.871-1.360=-0.489
policies=20
mean1758.618-1758.613=0.006
σ0.336-0.344=-0.008
min1758.400-1758.393=0.007
max1759.118-1759.123=-0.004
mean820.000
σ0.000
min820.000
max820.000
mean2834.000-2683.000=151.000
σ0.000
min2834.000-2683.000=151.000
max2834.000-2683.000=151.000
mean2.761-2.706=0.055
σ0.009-0.043=-0.034
min2.753-2.658=0.095
max2.774-2.763=0.010
policies=200
mean17593.258-17593.226=0.032
σ0.482-0.481=0.001
min17592.913-17592.958=-0.044
max17593.971-17593.945=0.026
mean8200.000
σ0.000
min8200.000
max8200.000
mean2834.000-2683.000=151.000
σ0.000
min2834.000-2683.000=151.000
max2834.000-2683.000=151.000
mean27.681-27.251=0.430
σ0.372-0.149=0.223
min27.301-27.065=0.236
max28.143-27.418=0.725