Compare commits

Home / Compare 5b738507 .. 8dad54e4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.957=0.017
σ0.106-0.103=0.003
min35.926-35.912=0.014
max36.275-36.249=0.026
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.077-0.076=0.001
σ0.004-0.004=0.001
min0.071-0.071=-0.000
max0.085-0.083=0.002
cache=y
dps=1
iters=10
policies=100
mean26.209-26.203=0.006
σ0.003-0.004=-0.001
min26.203-26.197=0.006
max26.214-26.211=0.003
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.060-0.060=0.000
σ0.003-0.003=-0.000
min0.056-0.056=-0.000
max0.068-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.363-1756.303=2.060
σ0.372-0.367=0.004
min1757.786-1755.729=2.057
max1758.956-1756.896=2.060
mean1656.250-1655.000=1.250
σ624.261-636.645=-12.384
min684.000-609.000=75.000
max2764.000-2684.000=80.000
mean2.391-2.381=0.010
σ0.088-0.182=-0.094
min2.288-2.258=0.030
max2.561-3.089=-0.529

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.510-278.822=0.688
σ0.005-0.004=0.001
min279.505-278.817=0.688
max279.517-278.828=0.689
mean2764.000-2684.000=80.000
σ0.000
min2764.000-2684.000=80.000
max2764.000-2684.000=80.000
mean0.408-0.409=-0.001
σ0.004-0.005=-0.001
min0.405-0.406=-0.002
max0.415-0.418=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2178.442-2268.888=-90.445
σ0.019-0.008=0.012
min2178.421-2268.878=-90.457
max2178.472-2268.898=-90.426
mean2764.000-2684.000=80.000
σ0.000
min2764.000-2684.000=80.000
max2764.000-2684.000=80.000
mean3.318-2.966=0.351
σ0.264-0.139=0.125
min3.088-2.891=0.197
max3.773-3.214=0.559
iters=5
new-facts=6402
prior-facts=1
mean5056.375-4954.293=102.081
σ0.986-1.023=-0.037
min5055.811-4953.577=102.233
max5058.124-4956.100=102.024
mean2764.000-2684.000=80.000
σ0.000
min2764.000-2684.000=80.000
max2764.000-2684.000=80.000
mean9.017-8.188=0.829
σ0.733-0.711=0.023
min7.912-7.685=0.226
max9.817-9.409=0.408
iters=5
new-facts=6402
prior-facts=6402
mean5193.739-5168.832=24.907
σ0.103-0.100=0.003
min5193.621-5168.721=24.900
max5193.850-5168.915=24.935
mean3244.000-3441.400=-197.400
σ482.498-455.336=27.162
min2764.000-2789.000=-25.000
max3922.000-3975.000=-53.000
mean8.740-9.550=-0.810
σ0.151-0.475=-0.324
min8.616-9.000=-0.384
max8.995-10.237=-1.242

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.033-1.231=-0.198
σ0.066-0.340=-0.274
min0.951-0.940=0.011
max1.085-1.805=-0.720

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.479-460.351=5.128
σ572.669-572.662=0.007
min179.141-174.015=5.126
max1324.483-1319.345=5.138
mean79.500
σ7.000
min76.000
max90.000
mean2764.000-2684.000=80.000
σ0.000
min2764.000-2684.000=80.000
max2764.000-2684.000=80.000
mean0.484-0.564=-0.080
σ0.405-0.575=-0.170
min0.280-0.266=0.015
max1.091-1.426=-0.335
policies=20
mean1791.664-1740.415=51.249
σ0.326-0.321=0.005
min1791.470-1740.211=51.259
max1792.148-1740.894=51.254
mean760.000
σ0.000
min760.000
max760.000
mean2764.000-2684.000=80.000
σ0.000
min2764.000-2684.000=80.000
max2764.000-2684.000=80.000
mean2.795-2.694=0.101
σ0.013-0.042=-0.030
min2.778-2.664=0.114
max2.809-2.756=0.053
policies=200
mean17923.278-17411.238=512.039
σ0.543-0.502=0.041
min17922.859-17410.886=511.973
max17924.071-17411.980=512.092
mean7600.000
σ0.000
min7600.000
max7600.000
mean2764.000-2684.000=80.000
σ0.000
min2764.000-2684.000=80.000
max2764.000-2684.000=80.000
mean28.185-26.948=1.237
σ0.114-0.113=0.001
min28.059-26.869=1.191
max28.293-27.112=1.180