Compare commits

Home / Compare 76c5976c .. c95cb7e4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.964-35.964=-0.000
σ0.106-0.105=0.001
min35.911-35.909=0.002
max36.263-36.262=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.074-0.076=-0.002
σ0.004-0.003=0.000
min0.070-0.074=-0.004
max0.081-0.084=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.202-26.201=0.001
σ0.003-0.002=0.001
min26.195-26.198=-0.003
max26.207-26.205=0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.059-0.058=0.002
σ0.003-0.002=0.000
min0.057-0.056=0.001
max0.066-0.064=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.924-1756.924=0.001
σ0.369-0.368=0.000
min1756.351-1756.353=-0.002
max1757.519-1757.524=-0.005
mean1658.700-1658.400=0.300
σ640.984-640.793=0.192
min609.000
max2685.000-2684.000=1.000
mean2.394-2.379=0.016
σ0.180-0.178=0.002
min2.211-2.237=-0.025
max3.072-3.075=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.436-279.437=-0.001
σ0.005-0.007=-0.003
min279.432-279.425=0.007
max279.443-279.444=-0.001
mean2685.000-2684.000=1.000
σ0.000
min2685.000-2684.000=1.000
max2685.000-2684.000=1.000
mean0.413-0.415=-0.002
σ0.004-0.005=-0.001
min0.410-0.411=-0.000
max0.421-0.422=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2269.495-2269.495=-0.001
σ0.009-0.005=0.005
min2269.479-2269.489=-0.010
max2269.504-2269.500=0.004
mean2685.000-2684.000=1.000
σ0.000
min2685.000-2684.000=1.000
max2685.000-2684.000=1.000
mean2.909-2.923=-0.015
σ0.084-0.119=-0.035
min2.811-2.820=-0.010
max3.043-3.129=-0.087
iters=5
new-facts=6402
prior-facts=1
mean4954.871-4954.602=0.269
σ0.908-1.047=-0.139
min4954.308-4953.832=0.476
max4956.480-4956.394=0.085
mean2685.000-2684.000=1.000
σ0.000
min2685.000-2684.000=1.000
max2685.000-2684.000=1.000
mean8.099-8.166=-0.067
σ0.355-0.200=0.155
min7.774-7.961=-0.187
max8.609-8.495=0.114
iters=5
new-facts=6402
prior-facts=6402
mean5169.239-5169.367=-0.127
σ0.314-0.148=0.166
min5168.820-5169.148=-0.328
max5169.506-5169.507=-0.001
mean3399.600-3436.200=-36.600
σ484.723-462.994=21.730
min2820.000-2821.000=-1.000
max4064.000-4041.000=23.000
mean9.521-9.322=0.199
σ0.502-0.450=0.052
min9.136-8.609=0.527
max10.397-9.755=0.642

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.093-1.063=0.031
σ0.143-0.104=0.038
min0.954-0.952=0.002
max1.271-1.217=0.054

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean461.590-461.587=0.003
σ572.649-572.654=-0.005
min175.256-175.252=0.004
max1320.563-1320.567=-0.004
mean77.500
σ7.000
min74.000
max88.000
mean2685.000-2684.000=1.000
σ0.000
min2685.000-2684.000=1.000
max2685.000-2684.000=1.000
mean0.480-0.557=-0.077
σ0.417-0.561=-0.143
min0.267-0.274=-0.007
max1.106-1.398=-0.292
policies=20
mean1752.806-1752.816=-0.010
σ0.326-0.343=-0.017
min1752.596-1752.601=-0.006
max1753.290-1753.327=-0.036
mean740.000
σ0.000
min740.000
max740.000
mean2685.000-2684.000=1.000
σ0.000
min2685.000-2684.000=1.000
max2685.000-2684.000=1.000
mean2.717-2.738=-0.021
σ0.015-0.035=-0.020
min2.697-2.700=-0.003
max2.731-2.784=-0.053
policies=200
mean17534.664-17534.566=0.099
σ0.505-0.449=0.057
min17534.357-17534.192=0.165
max17535.420-17535.212=0.209
mean7400.000
σ0.000
min7400.000
max7400.000
mean2685.000-2684.000=1.000
σ0.000
min2685.000-2684.000=1.000
max2685.000-2684.000=1.000
mean27.394-27.481=-0.087
σ0.051-0.136=-0.085
min27.337-27.320=0.016
max27.460-27.637=-0.177