Compare commits

Home / Compare 4edc03a7 .. 6e6b2897

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.242=0.001
σ0.055-0.055=-0.000
min35.218-35.212=0.006
max35.398-35.397=0.001
mean414.200-417.000=-2.800
σ0.422-0.000=0.422
min414.000-417.000=-3.000
max415.000-417.000=-2.000
mean0.085-0.082=0.003
σ0.003-0.006=-0.003
min0.082-0.076=0.005
max0.091-0.094=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.003-0.003=0.000
min23.764-23.766=-0.001
max23.774-23.774=-0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.068-0.067=0.001
σ0.003-0.003=-0.000
min0.066-0.061=0.005
max0.074-0.074=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.485=0.000
σ0.365-0.365=0.000
min1755.910-1755.909=0.000
max1757.077-1757.070=0.007
mean1650.200-1655.400=-5.200
σ639.571-642.842=-3.271
min628.000-629.000=-1.000
max2827.000-2838.000=-11.000
mean2.339-2.344=-0.005
σ0.092-0.076=0.016
min2.151-2.241=-0.090
max2.584-2.540=0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.708-324.705=0.003
σ0.048-0.048=0.000
min324.624-324.621=0.003
max324.741-324.737=0.004
mean2827.000-2838.000=-11.000
σ0.000
min2827.000-2838.000=-11.000
max2827.000-2838.000=-11.000
mean0.423-0.423=-0.001
σ0.001-0.002=-0.000
min0.421-0.421=-0.001
max0.425-0.426=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.260-1985.272=-0.011
σ0.016-0.005=0.011
min1985.242-1985.265=-0.022
max1985.275-1985.276=-0.001
mean2827.000-2838.000=-11.000
σ0.000
min2827.000-2838.000=-11.000
max2827.000-2838.000=-11.000
mean2.590-2.611=-0.022
σ0.041-0.062=-0.020
min2.552-2.546=0.007
max2.657-2.694=-0.038
iters=5
new-facts=6402
prior-facts=1
mean4808.655-4808.851=-0.195
σ7.792-7.676=0.116
min4804.784-4805.390=-0.605
max4822.578-4822.581=-0.003
mean2827.000-2838.000=-11.000
σ0.000
min2827.000-2838.000=-11.000
max2827.000-2838.000=-11.000
mean8.637-8.910=-0.273
σ0.555-0.111=0.444
min7.682-8.799=-1.117
max9.045-9.056=-0.011
iters=5
new-facts=6402
prior-facts=6402
mean4996.463-4996.321=0.142
σ0.018-0.178=-0.160
min4996.443-4996.115=0.328
max4996.481-4996.467=0.014
mean3046.800-3056.800=-10.000
σ199.416-205.639=-6.223
min2827.000-2838.000=-11.000
max3335.000-3358.000=-23.000
mean8.783-8.647=0.135
σ0.434-0.258=0.176
min8.427-8.381=0.046
max9.493-9.012=0.480

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.945-0.971=-0.027
σ0.058-0.060=-0.002
min0.911-0.922=-0.010
max1.046-1.044=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.965-462.975=-0.010
σ574.249-574.254=-0.005
min175.834-175.841=-0.007
max1324.338-1324.356=-0.017
mean86.250
σ8.500
min82.000
max99.000
mean2827.000-2838.000=-11.000
σ0.000
min2827.000-2838.000=-11.000
max2827.000-2838.000=-11.000
mean0.430-0.436=-0.006
σ0.295-0.307=-0.012
min0.278-0.280=-0.001
max0.873-0.896=-0.023
policies=20
mean1758.726-1758.713=0.014
σ0.343-0.351=-0.008
min1758.498-1758.472=0.026
max1759.232-1759.231=0.001
mean820.000
σ0.000
min820.000
max820.000
mean2827.000-2838.000=-11.000
σ0.000
min2827.000-2838.000=-11.000
max2827.000-2838.000=-11.000
mean2.807-2.783=0.023
σ0.030-0.024=0.006
min2.783-2.752=0.031
max2.851-2.809=0.041
policies=200
mean17593.143-17593.315=-0.172
σ0.799-0.618=0.181
min17592.035-17592.607=-0.573
max17593.855-17593.892=-0.037
mean8200.000
σ0.000
min8200.000
max8200.000
mean2827.000-2838.000=-11.000
σ0.000
min2827.000-2838.000=-11.000
max2827.000-2838.000=-11.000
mean27.815-27.837=-0.022
σ0.330-0.434=-0.104
min27.507-27.293=0.214
max28.219-28.223=-0.004