Compare commits

Home / Compare ba677b9b .. 65ec2e51

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.263=0.355
σ0.054-0.055=-0.002
min35.590-35.230=0.360
max35.770-35.418=0.351
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.083-0.083=-0.000
σ0.005-0.004=0.001
min0.076-0.077=-0.000
max0.092-0.088=0.004
cache=y
dps=1
iters=10
policies=100
mean24.048-23.769=0.280
σ0.003-0.003=0.000
min24.044-23.764=0.279
max24.054-23.774=0.281
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.069-0.067=0.003
σ0.003-0.005=-0.001
min0.067-0.061=0.007
max0.076-0.076=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.492-1756.485=0.007
σ0.366-0.366=-0.000
min1755.919-1755.909=0.010
max1757.078-1757.079=-0.001
mean1648.250-1646.300=1.950
σ633.167-639.692=-6.525
min622.000-623.000=-1.000
max2830.000-2823.000=7.000
mean2.326-2.330=-0.004
σ0.103-0.067=0.036
min2.072-2.238=-0.166
max2.497-2.468=0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.778-324.682=0.096
σ0.033-0.051=-0.018
min324.722-324.593=0.129
max324.807-324.716=0.090
mean2830.000-2823.000=7.000
σ0.000
min2830.000-2823.000=7.000
max2830.000-2823.000=7.000
mean0.423-0.438=-0.015
σ0.001-0.017=-0.016
min0.422-0.425=-0.003
max0.425-0.466=-0.041
iters=5
new-facts=1
prior-facts=6402
mean1985.323-1985.266=0.057
σ0.015-0.010=0.005
min1985.306-1985.250=0.057
max1985.337-1985.274=0.062
mean2830.000-2823.000=7.000
σ0.000
min2830.000-2823.000=7.000
max2830.000-2823.000=7.000
mean2.621-2.687=-0.066
σ0.054-0.163=-0.109
min2.573-2.510=0.063
max2.690-2.890=-0.201
iters=5
new-facts=6402
prior-facts=1
mean4808.808-4808.672=0.136
σ7.790-7.216=0.574
min4804.837-4805.422=-0.584
max4822.735-4821.581=1.154
mean2830.000-2823.000=7.000
σ0.000
min2830.000-2823.000=7.000
max2830.000-2823.000=7.000
mean8.712-9.145=-0.433
σ0.264-0.200=0.064
min8.342-8.977=-0.635
max9.044-9.469=-0.425
iters=5
new-facts=6402
prior-facts=6402
mean4996.530-4996.467=0.063
σ0.025-0.018=0.007
min4996.504-4996.446=0.058
max4996.563-4996.489=0.074
mean3034.200-3029.400=4.800
σ280.479-281.789=-1.309
min2830.000-2823.000=7.000
max3475.000-3471.000=4.000
mean8.489-8.507=-0.018
σ0.150-0.127=0.022
min8.370-8.359=0.012
max8.750-8.699=0.051

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.944-0.973=-0.029
σ0.056-0.067=-0.011
min0.910-0.916=-0.006
max1.041-1.052=-0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.947-462.972=-0.025
σ574.251-574.256=-0.005
min175.819-175.836=-0.017
max1324.323-1324.355=-0.032
mean86.250
σ8.500
min82.000
max99.000
mean2830.000-2823.000=7.000
σ0.000
min2830.000-2823.000=7.000
max2830.000-2823.000=7.000
mean0.426-0.431=-0.005
σ0.294-0.298=-0.005
min0.276-0.278=-0.002
max0.867-0.879=-0.012
policies=20
mean1758.523-1758.718=-0.195
σ0.340-0.342=-0.002
min1758.315-1758.487=-0.172
max1759.030-1759.225=-0.195
mean820.000
σ0.000
min820.000
max820.000
mean2830.000-2823.000=7.000
σ0.000
min2830.000-2823.000=7.000
max2830.000-2823.000=7.000
mean2.791-2.799=-0.008
σ0.012-0.004=0.008
min2.781-2.794=-0.013
max2.807-2.801=0.006
policies=200
mean17591.973-17593.366=-1.393
σ0.546-0.723=-0.178
min17591.663-17592.370=-0.707
max17592.790-17593.930=-1.140
mean8200.000
σ0.000
min8200.000
max8200.000
mean2830.000-2823.000=7.000
σ0.000
min2830.000-2823.000=7.000
max2830.000-2823.000=7.000
mean27.773-27.935=-0.162
σ0.392-0.353=0.039
min27.360-27.588=-0.227
max28.176-28.350=-0.174