Compare commits

Home / Compare 2aeaf1c4 .. 8f667dfb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.263=-0.001
σ0.054-0.055=-0.001
min35.230-35.230=0.000
max35.416-35.418=-0.003
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.084-0.083=0.001
σ0.003-0.004=-0.001
min0.082-0.077=0.006
max0.092-0.088=0.004
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.004-0.003=0.001
min23.764
max23.776-23.774=0.002
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.069-0.067=0.002
σ0.003-0.005=-0.001
min0.066-0.061=0.005
max0.075-0.076=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.485=0.000
σ0.365-0.366=-0.001
min1755.909-1755.909=0.000
max1757.072-1757.079=-0.007
mean1647.900-1646.300=1.600
σ642.307-639.692=2.615
min623.000
max2840.000-2823.000=17.000
mean2.345-2.330=0.015
σ0.098-0.067=0.031
min2.245-2.238=0.007
max2.583-2.468=0.115

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.683-324.682=0.001
σ0.041-0.051=-0.010
min324.611-324.593=0.019
max324.708-324.716=-0.009
mean2840.000-2823.000=17.000
σ0.000
min2840.000-2823.000=17.000
max2840.000-2823.000=17.000
mean0.430-0.438=-0.008
σ0.007-0.017=-0.010
min0.423-0.425=-0.001
max0.440-0.466=-0.026
iters=5
new-facts=1
prior-facts=6402
mean1985.261-1985.266=-0.005
σ0.015-0.010=0.004
min1985.244-1985.250=-0.006
max1985.273-1985.274=-0.002
mean2840.000-2823.000=17.000
σ0.000
min2840.000-2823.000=17.000
max2840.000-2823.000=17.000
mean2.659-2.687=-0.029
σ0.146-0.163=-0.017
min2.520-2.510=0.010
max2.855-2.890=-0.035
iters=5
new-facts=6402
prior-facts=1
mean4808.898-4808.672=0.226
σ7.688-7.216=0.472
min4805.396-4805.422=-0.026
max4822.651-4821.581=1.070
mean2840.000-2823.000=17.000
σ0.000
min2840.000-2823.000=17.000
max2840.000-2823.000=17.000
mean9.109-9.145=-0.037
σ0.292-0.200=0.092
min8.673-8.977=-0.304
max9.362-9.469=-0.107
iters=5
new-facts=6402
prior-facts=6402
mean4996.469-4996.467=0.002
σ0.009-0.018=-0.009
min4996.458-4996.446=0.012
max4996.480-4996.489=-0.009
mean3041.800-3029.400=12.400
σ203.884-281.789=-77.905
min2840.000-2823.000=17.000
max3319.000-3471.000=-152.000
mean8.806-8.507=0.299
σ0.247-0.127=0.120
min8.501-8.359=0.143
max9.144-8.699=0.445

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.998-0.973=0.025
σ0.062-0.067=-0.005
min0.920-0.916=0.004
max1.048-1.052=-0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.978-462.972=0.006
σ574.252-574.256=-0.003
min175.838-175.836=0.002
max1324.356-1324.355=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2823.000=17.000
σ0.000
min2840.000-2823.000=17.000
max2840.000-2823.000=17.000
mean0.431-0.431=0.000
σ0.299-0.298=0.001
min0.276-0.278=-0.002
max0.880-0.879=0.001
policies=20
mean1758.707-1758.718=-0.011
σ0.347-0.342=0.005
min1758.470-1758.487=-0.017
max1759.220-1759.225=-0.005
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2823.000=17.000
σ0.000
min2840.000-2823.000=17.000
max2840.000-2823.000=17.000
mean2.803-2.799=0.004
σ0.007-0.004=0.004
min2.797-2.794=0.003
max2.814-2.801=0.012
policies=200
mean17593.288-17593.366=-0.078
σ0.676-0.723=-0.047
min17592.420-17592.370=0.050
max17593.861-17593.930=-0.070
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2823.000=17.000
σ0.000
min2840.000-2823.000=17.000
max2840.000-2823.000=17.000
mean27.931-27.935=-0.003
σ0.374-0.353=0.021
min27.475-27.588=-0.113
max28.362-28.350=0.012