Compare commits

Home / Compare 7aff85b3 .. 92c3ee53

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.264=0.354
σ0.053-0.053=0.000
min35.589-35.234=0.356
max35.767-35.412=0.356
mean415.600-415.300=0.300
σ0.516-0.483=0.033
min415.000
max416.000
mean0.086-0.085=0.001
σ0.004-0.004=-0.000
min0.082-0.082=-0.000
max0.093-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean24.048-23.770=0.278
σ0.002-0.003=-0.001
min24.045-23.767=0.278
max24.051-23.774=0.278
mean416.000
σ0.000
min416.000
max416.000
mean0.068-0.068=0.000
σ0.003-0.003=0.001
min0.066-0.066=-0.000
max0.076-0.074=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.486=0.004
σ0.364-0.366=-0.001
min1755.916-1755.909=0.007
max1757.081-1757.074=0.007
mean1653.900-1640.350=13.550
σ629.168-604.394=24.774
min619.000-651.000=-32.000
max2690.000-2451.000=239.000
mean2.350-2.351=-0.002
σ0.104-0.124=-0.020
min2.239-2.170=0.069
max2.652-2.665=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.766-324.712=0.054
σ0.048-0.037=0.011
min324.681-324.646=0.035
max324.793-324.730=0.063
mean2690.000-2451.000=239.000
σ0.000
min2690.000-2451.000=239.000
max2690.000-2451.000=239.000
mean0.427-0.425=0.003
σ0.010-0.001=0.009
min0.420-0.423=-0.003
max0.445-0.426=0.018
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.262=0.055
σ0.020-0.020=-0.000
min1985.284-1985.227=0.057
max1985.332-1985.276=0.056
mean2690.000-2451.000=239.000
σ0.000
min2690.000-2451.000=239.000
max2690.000-2451.000=239.000
mean2.617-2.671=-0.054
σ0.079-0.181=-0.103
min2.558-2.482=0.077
max2.733-2.874=-0.141
iters=5
new-facts=6402
prior-facts=1
mean4808.975-4808.861=0.113
σ7.796-7.671=0.125
min4805.048-4805.331=-0.284
max4822.914-4822.583=0.331
mean2690.000-2451.000=239.000
σ0.000
min2690.000-2451.000=239.000
max2690.000-2451.000=239.000
mean9.029-8.871=0.157
σ0.132-0.230=-0.098
min8.889-8.605=0.285
max9.234-9.121=0.113
iters=5
new-facts=6402
prior-facts=6402
mean4996.494-4996.467=0.027
σ0.178-0.018=0.160
min4996.285-4996.438=-0.153
max4996.640-4996.482=0.158
mean3058.800-2945.800=113.000
σ293.251-444.588=-151.337
min2690.000-2451.000=239.000
max3333.000-3546.000=-213.000
mean8.914-8.461=0.453
σ0.415-0.104=0.311
min8.568-8.356=0.212
max9.554-8.617=0.938

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.952-1.643=-0.691
σ0.057-0.124=-0.067
min0.917-1.450=-0.533
max1.050-1.770=-0.720

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.215-462.944=0.270
σ574.773-574.246=0.527
min175.813-175.817=-0.005
max1325.373-1324.313=1.061
mean86.250
σ8.500
min82.000
max99.000
mean2690.000-2451.000=239.000
σ0.000
min2690.000-2451.000=239.000
max2690.000-2451.000=239.000
mean0.564-0.552=0.012
σ0.578-0.552=0.026
min0.272-0.274=-0.002
max1.431-1.380=0.051
policies=20
mean1758.505-1758.517=-0.012
σ0.333-0.345=-0.012
min1758.295-1758.265=0.030
max1759.001-1759.025=-0.024
mean820.000
σ0.000
min820.000
max820.000
mean2690.000-2451.000=239.000
σ0.000
min2690.000-2451.000=239.000
max2690.000-2451.000=239.000
mean2.717-2.714=0.003
σ0.012-0.017=-0.005
min2.704-2.695=0.010
max2.729-2.730=-0.001
policies=200
mean17592.116-17592.342=-0.226
σ0.421-0.447=-0.026
min17591.847-17591.996=-0.149
max17592.744-17592.989=-0.246
mean8200.000
σ0.000
min8200.000
max8200.000
mean2690.000-2451.000=239.000
σ0.000
min2690.000-2451.000=239.000
max2690.000-2451.000=239.000
mean27.450-27.600=-0.150
σ0.029-0.108=-0.079
min27.432-27.512=-0.080
max27.492-27.735=-0.243