Compare commits

Home / Compare e4e72b1a .. 685ddd20

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.970-35.970=-0.000
σ0.104-0.106=-0.002
min35.927-35.923=0.004
max36.266-36.270=-0.004
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.077-0.077=-0.000
σ0.004-0.004=0.000
min0.075-0.074=0.001
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean26.207-26.209=-0.002
σ0.004-0.003=0.001
min26.203-26.204=-0.000
max26.214-26.213=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.059-0.062=-0.002
σ0.003-0.003=0.000
min0.056-0.060=-0.004
max0.066-0.069=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.760-1757.762=-0.002
σ0.369-0.370=-0.000
min1757.182-1757.182=-0.000
max1758.342-1758.354=-0.012
mean1652.800-1639.550=13.250
σ626.233-628.693=-2.460
min672.000-622.000=50.000
max2683.000-2680.000=3.000
mean2.371-2.383=-0.013
σ0.114-0.116=-0.003
min2.226-2.253=-0.027
max2.690-2.625=0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean280.290-280.289=0.002
σ0.003-0.006=-0.003
min280.286-280.279=0.007
max280.295-280.294=0.001
mean2683.000-2680.000=3.000
σ0.000
min2683.000-2680.000=3.000
max2683.000-2680.000=3.000
mean0.412-0.410=0.002
σ0.001-0.001=0.000
min0.410-0.408=0.002
max0.414-0.411=0.002
iters=5
new-facts=1
prior-facts=6402
mean2270.294-2270.312=-0.018
σ0.026-0.029=-0.003
min2270.263-2270.277=-0.014
max2270.323-2270.357=-0.034
mean2683.000-2680.000=3.000
σ0.000
min2683.000-2680.000=3.000
max2683.000-2680.000=3.000
mean2.986-3.113=-0.126
σ0.114-0.251=-0.136
min2.826-2.832=-0.006
max3.118-3.428=-0.310
iters=5
new-facts=6402
prior-facts=1
mean5147.582-5147.587=-0.006
σ1.012-1.014=-0.002
min5146.996-5146.973=0.023
max5149.382-5149.376=0.007
mean2683.000-2680.000=3.000
σ0.000
min2683.000-2680.000=3.000
max2683.000-2680.000=3.000
mean8.990-9.030=-0.039
σ0.585-0.660=-0.075
min8.287-8.254=0.033
max9.689-9.848=-0.159
iters=5
new-facts=6402
prior-facts=6402
mean5285.572-5285.587=-0.015
σ0.136-0.152=-0.016
min5285.367-5285.416=-0.049
max5285.748-5285.760=-0.012
mean3487.600-3488.400=-0.800
σ541.401-534.888=6.514
min2770.000-2781.000=-11.000
max4004.000-3999.000=5.000
mean9.949-9.961=-0.012
σ0.511-0.634=-0.123
min9.185-8.861=0.324
max10.445-10.366=0.079

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.026-1.055=-0.029
σ0.112-0.110=0.002
min0.939-0.949=-0.010
max1.203-1.216=-0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.298-464.297=0.001
σ572.656-572.660=-0.004
min177.963-177.958=0.005
max1323.283-1323.288=-0.005
mean81.500
σ7.000
min78.000
max92.000
mean2683.000-2680.000=3.000
σ0.000
min2683.000-2680.000=3.000
max2683.000-2680.000=3.000
mean0.560-0.547=0.013
σ0.559-0.540=0.018
min0.278-0.276=0.002
max1.398-1.358=0.040
policies=20
mean1779.915-1779.916=-0.001
σ0.376-0.385=-0.008
min1779.689-1779.688=0.001
max1780.477-1780.491=-0.015
mean780.000
σ0.000
min780.000
max780.000
mean2683.000-2680.000=3.000
σ0.000
min2683.000-2680.000=3.000
max2683.000-2680.000=3.000
mean2.791-2.787=0.003
σ0.024-0.017=0.007
min2.756-2.770=-0.013
max2.812-2.808=0.004
policies=200
mean17805.992-17805.996=-0.004
σ0.471-0.499=-0.028
min17805.739-17805.706=0.034
max17806.698-17806.743=-0.045
mean7800.000
σ0.000
min7800.000
max7800.000
mean2683.000-2680.000=3.000
σ0.000
min2683.000-2680.000=3.000
max2683.000-2680.000=3.000
mean28.055-28.001=0.054
σ0.131-0.100=0.031
min27.896-27.909=-0.013
max28.186-28.144=0.042