Compare commits

Home / Compare 52b08f65 .. 312982b7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.975=-0.001
σ0.107-0.107=0.000
min35.926-35.926=0.000
max36.277-36.278=-0.001
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.077-0.077=-0.000
σ0.004-0.003=0.000
min0.073-0.075=-0.002
max0.084-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.000
σ0.004-0.003=0.001
min26.202-26.205=-0.003
max26.215-26.214=0.001
mean411.000-415.500=-4.500
σ0.000-0.527=-0.527
min411.000-415.000=-4.000
max411.000-416.000=-5.000
mean0.060-0.061=-0.001
σ0.004-0.003=0.002
min0.057-0.060=-0.003
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.362-1758.362=-0.001
σ0.373-0.373=0.000
min1757.788-1757.787=0.001
max1758.962-1758.963=-0.001
mean1657.200-1661.550=-4.350
σ630.221-635.009=-4.789
min683.000-680.000=3.000
max2804.000-2704.000=100.000
mean2.400-2.411=-0.011
σ0.134-0.088=0.045
min2.274-2.325=-0.051
max2.814-2.653=0.161

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.508-279.515=-0.007
σ0.005-0.011=-0.006
min279.503-279.503=-0.000
max279.515-279.526=-0.011
mean2804.000-2704.000=100.000
σ0.000
min2804.000-2704.000=100.000
max2804.000-2704.000=100.000
mean0.407-0.411=-0.004
σ0.006-0.005=0.000
min0.404-0.406=-0.003
max0.418-0.420=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2178.446-2178.446=0.001
σ0.011-0.022=-0.011
min2178.434-2178.419=0.015
max2178.462-2178.475=-0.013
mean2804.000-2704.000=100.000
σ0.000
min2804.000-2704.000=100.000
max2804.000-2704.000=100.000
mean3.388-3.239=0.150
σ0.139-0.253=-0.114
min3.208-2.941=0.267
max3.552-3.588=-0.037
iters=5
new-facts=6402
prior-facts=1
mean5056.280-5056.157=0.123
σ1.110-1.203=-0.094
min5055.164-5054.864=0.300
max5058.139-5058.132=0.007
mean2804.000-2704.000=100.000
σ0.000
min2804.000-2704.000=100.000
max2804.000-2704.000=100.000
mean9.269-9.247=0.022
σ0.651-0.566=0.085
min8.234-8.271=-0.037
max10.000-9.689=0.311
iters=5
new-facts=6402
prior-facts=6402
mean5193.690-5193.755=-0.065
σ0.204-0.091=0.113
min5193.353-5193.683=-0.330
max5193.864-5193.857=0.007
mean3247.400-3287.400=-40.000
σ319.959-393.841=-73.882
min2804.000-2735.000=69.000
max3676.000-3657.000=19.000
mean9.155-9.006=0.149
σ0.432-0.257=0.175
min8.726-8.752=-0.026
max9.694-9.426=0.268

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.090-1.123=-0.033
σ0.197-0.252=-0.054
min0.939-0.941=-0.002
max1.423-1.557=-0.134

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.476-465.476=0.000
σ572.648-572.659=-0.011
min179.140-179.140=0.000
max1324.448-1324.464=-0.017
mean79.500
σ7.000
min76.000
max90.000
mean2804.000-2704.000=100.000
σ0.000
min2804.000-2704.000=100.000
max2804.000-2704.000=100.000
mean0.443-0.559=-0.116
σ0.304-0.552=-0.248
min0.289-0.280=0.009
max0.899-1.387=-0.488
policies=20
mean1791.718-1791.689=0.029
σ0.330-0.352=-0.022
min1791.485-1791.451=0.034
max1792.194-1792.210=-0.016
mean760.000
σ0.000
min760.000
max760.000
mean2804.000-2704.000=100.000
σ0.000
min2804.000-2704.000=100.000
max2804.000-2704.000=100.000
mean2.858-2.825=0.033
σ0.124-0.018=0.106
min2.784-2.803=-0.018
max3.043-2.844=0.199
policies=200
mean17923.470-17923.357=0.114
σ0.485-0.603=-0.118
min17923.202-17922.976=0.226
max17924.196-17924.250=-0.054
mean7600.000
σ0.000
min7600.000
max7600.000
mean2804.000-2704.000=100.000
σ0.000
min2804.000-2704.000=100.000
max2804.000-2704.000=100.000
mean28.294-28.424=-0.130
σ0.132-0.070=0.062
min28.179-28.339=-0.159
max28.411-28.497=-0.086