Compare commits

Home / Compare 1e973a0a .. fb55cea4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.039-31.041=-0.002
σ0.049-0.049=-0.000
min31.001-31.006=-0.005
max31.176-31.179=-0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.076-0.077=-0.001
σ0.003-0.005=-0.001
min0.071-0.072=-0.001
max0.080-0.085=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.142-21.142=-0.000
σ0.002-0.003=-0.001
min21.138-21.138=0.000
max21.145-21.148=-0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.065-0.065=0.000
σ0.002-0.002=-0.000
min0.063-0.063=-0.000
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.411=-0.001
σ0.361-0.362=-0.001
min1750.846-1750.842=0.004
max1751.979-1751.994=-0.016
mean1652.000-1659.600=-7.600
σ645.383-623.370=22.013
min648.000-659.000=-11.000
max2846.000-2506.000=340.000
mean2.831-2.824=0.008
σ0.196-0.106=0.090
min2.270-2.550=-0.280
max3.216-3.031=0.185

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.398-273.405=-0.007
σ0.007-0.011=-0.003
min273.390-273.394=-0.005
max273.405-273.419=-0.014
mean2846.000-2506.000=340.000
σ0.000
min2846.000-2506.000=340.000
max2846.000-2506.000=340.000
mean0.388-0.389=-0.001
σ0.008-0.010=-0.002
min0.379-0.379=-0.000
max0.396-0.398=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1933.836-1933.844=-0.008
σ0.011-0.007=0.005
min1933.825-1933.836=-0.011
max1933.855-1933.854=0.001
mean2846.000-2506.000=340.000
σ0.000
min2846.000-2506.000=340.000
max2846.000-2506.000=340.000
mean2.998-3.036=-0.039
σ0.139-0.252=-0.113
min2.772-2.763=0.009
max3.123-3.357=-0.234
iters=5
new-facts=6402
prior-facts=1
mean4754.377-4754.339=0.038
σ0.850-0.884=-0.034
min4753.928-4753.848=0.079
max4755.894-4755.916=-0.021
mean2846.000-2506.000=340.000
σ0.000
min2846.000-2506.000=340.000
max2846.000-2506.000=340.000
mean8.245-8.467=-0.222
σ0.531-0.547=-0.016
min7.722-7.794=-0.072
max9.049-9.036=0.013
iters=5
new-facts=6402
prior-facts=6402
mean4944.726-4944.795=-0.069
σ0.126-0.072=0.053
min4944.530-4944.738=-0.208
max4944.880-4944.883=-0.003
mean3058.600-2915.800=142.800
σ274.087-377.781=-103.694
min2846.000-2506.000=340.000
max3480.000-3433.000=47.000
mean8.586-8.516=0.070
σ0.420-0.211=0.209
min8.355-8.399=-0.044
max9.336-8.892=0.444

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.196-1.733=-0.537
σ0.203-0.181=0.022
min1.069-1.416=-0.347
max1.535-1.839=-0.304

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.341-463.329=0.012
σ572.209-572.195=0.014
min177.232-177.231=0.001
max1321.654-1321.621=0.033
mean79.750
σ7.500
min76.000
max91.000
mean2846.000-2506.000=340.000
σ0.000
min2846.000-2506.000=340.000
max2846.000-2506.000=340.000
mean0.441-0.537=-0.095
σ0.305-0.513=-0.208
min0.286-0.276=0.010
max0.898-1.306=-0.407
policies=20
mean1772.606-1772.559=0.047
σ0.341-0.326=0.014
min1772.360-1772.340=0.020
max1773.106-1773.043=0.063
mean760.000
σ0.000
min760.000
max760.000
mean2846.000-2506.000=340.000
σ0.000
min2846.000-2506.000=340.000
max2846.000-2506.000=340.000
mean2.843-2.746=0.097
σ0.007-0.020=-0.013
min2.833-2.729=0.103
max2.850-2.774=0.076
policies=200
mean17732.435-17732.390=0.045
σ0.422-0.406=0.016
min17731.952-17732.140=-0.189
max17732.981-17732.994=-0.013
mean7600.000
σ0.000
min7600.000
max7600.000
mean2846.000-2506.000=340.000
σ0.000
min2846.000-2506.000=340.000
max2846.000-2506.000=340.000
mean28.150-27.702=0.448
σ0.536-0.120=0.416
min27.603-27.634=-0.031
max28.619-27.882=0.737