Compare commits

Home / Compare 5d48553e .. 4192bed9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.959-35.959=-0.000
σ0.103-0.103=-0.000
min35.920-35.912=0.008
max36.251-36.252=-0.001
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.077-0.077=0.000
σ0.004-0.004=-0.000
min0.074-0.074=0.000
max0.085-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean26.203-26.201=0.002
σ0.004-0.003=0.001
min26.195-26.195=-0.000
max26.209-26.206=0.003
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.061-0.060=0.001
σ0.003-0.003=-0.000
min0.059-0.058=0.001
max0.068-0.067=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.659-1757.659=-0.001
σ0.371-0.371=-0.000
min1757.081-1757.081=0.001
max1758.253-1758.257=-0.005
mean1642.700-1654.000=-11.300
σ634.294-623.090=11.204
min625.000-680.000=-55.000
max2827.000-2658.000=169.000
mean2.374-2.360=0.015
σ0.197-0.093=0.104
min2.251-2.269=-0.018
max3.183-2.577=0.606

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean280.099-280.070=0.028
σ0.007-0.016=-0.009
min280.092-280.050=0.042
max280.110-280.093=0.017
mean2827.000-2658.000=169.000
σ0.000
min2827.000-2658.000=169.000
max2827.000-2658.000=169.000
mean0.417-0.415=0.002
σ0.008-0.004=0.004
min0.409-0.410=-0.001
max0.427-0.419=0.008
iters=5
new-facts=1
prior-facts=6402
mean2270.150-2270.157=-0.007
σ0.015-0.012=0.003
min2270.125-2270.138=-0.014
max2270.166-2270.170=-0.004
mean2827.000-2658.000=169.000
σ0.000
min2827.000-2658.000=169.000
max2827.000-2658.000=169.000
mean3.571-3.547=0.024
σ0.215-0.140=0.075
min3.307-3.427=-0.120
max3.820-3.778=0.042
iters=5
new-facts=6402
prior-facts=1
mean5139.176-5139.001=0.174
σ0.981-1.057=-0.076
min5138.534-5137.939=0.595
max5140.916-5140.780=0.136
mean2827.000-2658.000=169.000
σ0.000
min2827.000-2658.000=169.000
max2827.000-2658.000=169.000
mean8.795-8.576=0.218
σ0.804-0.418=0.386
min8.072-8.146=-0.073
max9.712-9.039=0.673
iters=5
new-facts=6402
prior-facts=6402
mean5277.144-5277.153=-0.009
σ0.195-0.125=0.070
min5276.823-5276.974=-0.151
max5277.323-5277.324=-0.002
mean3501.600-3482.800=18.800
σ522.500-529.530=-7.030
min2827.000-2773.000=54.000
max4007.000-3984.000=23.000
mean10.172-10.222=-0.050
σ0.203-0.434=-0.232
min9.873-9.616=0.257
max10.382-10.836=-0.454

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.198=-0.134
σ0.284-0.411=-0.127
min0.927-0.949=-0.022
max1.571-1.926=-0.354

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.171-464.169=0.002
σ572.660-572.655=0.005
min177.827-177.838=-0.011
max1323.160-1323.152=0.008
mean81.500
σ7.000
min78.000
max92.000
mean2827.000-2658.000=169.000
σ0.000
min2827.000-2658.000=169.000
max2827.000-2658.000=169.000
mean0.436-0.560=-0.124
σ0.297-0.562=-0.265
min0.286-0.275=0.010
max0.881-1.403=-0.522
policies=20
mean1778.646-1778.617=0.029
σ0.367-0.369=-0.002
min1778.422-1778.401=0.021
max1779.191-1779.170=0.021
mean780.000
σ0.000
min780.000
max780.000
mean2827.000-2658.000=169.000
σ0.000
min2827.000-2658.000=169.000
max2827.000-2658.000=169.000
mean2.841-2.766=0.075
σ0.013-0.023=-0.010
min2.822-2.737=0.085
max2.850-2.786=0.064
policies=200
mean17793.156-17793.071=0.084
σ0.484-0.539=-0.054
min17792.812-17792.721=0.091
max17793.873-17793.870=0.003
mean7800.000
σ0.000
min7800.000
max7800.000
mean2827.000-2658.000=169.000
σ0.000
min2827.000-2658.000=169.000
max2827.000-2658.000=169.000
mean28.214-27.967=0.248
σ0.383-0.087=0.295
min27.825-27.837=-0.012
max28.650-28.021=0.629