Compare commits

Home / Compare bfaa9a22 .. a5e56d11

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.980-35.964=0.016
σ0.108-0.105=0.002
min35.933-35.920=0.013
max36.283-36.262=0.021
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.078-0.077=0.000
σ0.004-0.003=0.001
min0.074-0.074=-0.001
max0.084-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.203=0.005
σ0.003-0.005=-0.002
min26.205-26.197=0.008
max26.213-26.212=0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.060-0.062=-0.003
σ0.004-0.003=0.001
min0.056-0.060=-0.004
max0.069-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.712-1756.610=0.103
σ0.369-0.370=-0.001
min1756.138-1756.039=0.099
max1757.315-1757.208=0.108
mean1642.750-1637.000=5.750
σ640.116-629.169=10.947
min640.000-638.000=2.000
max2837.000-2833.000=4.000
mean2.439-2.441=-0.002
σ0.082-0.154=-0.073
min2.356-2.304=0.052
max2.632-2.917=-0.285

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.880-277.692=0.188
σ0.007-0.009=-0.002
min277.870-277.679=0.191
max277.889-277.702=0.188
mean2837.000-2833.000=4.000
σ0.000
min2837.000-2833.000=4.000
max2837.000-2833.000=4.000
mean0.404-0.408=-0.004
σ0.007-0.006=0.001
min0.397-0.400=-0.003
max0.414-0.414=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2176.833-2176.655=0.177
σ0.014-0.012=0.001
min2176.813-2176.642=0.171
max2176.849-2176.670=0.179
mean2837.000-2833.000=4.000
σ0.000
min2837.000-2833.000=4.000
max2837.000-2833.000=4.000
mean3.492-2.961=0.531
σ0.088-0.108=-0.020
min3.393-2.823=0.571
max3.620-3.080=0.540
iters=5
new-facts=6402
prior-facts=1
mean5054.715-5046.164=8.551
σ0.925-0.982=-0.057
min5054.147-5045.292=8.855
max5056.359-5047.846=8.512
mean2837.000-2833.000=4.000
σ0.000
min2837.000-2833.000=4.000
max2837.000-2833.000=4.000
mean8.845-8.494=0.352
σ0.491-0.398=0.094
min8.212-8.053=0.159
max9.425-8.945=0.479
iters=5
new-facts=6402
prior-facts=6402
mean5192.061-5183.682=8.378
σ0.122-0.080=0.042
min5191.880-5183.611=8.269
max5192.224-5183.775=8.449
mean3300.000-3292.000=8.000
σ364.442-360.699=3.743
min2837.000-2833.000=4.000
max3657.000-3645.000=12.000
mean9.058-8.845=0.213
σ0.381-0.099=0.282
min8.664-8.718=-0.054
max9.689-8.974=0.715

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.076=-0.046
σ0.066-0.214=-0.148
min0.945-0.937=0.008
max1.083-1.443=-0.360

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.039-463.916=0.123
σ573.084-573.070=0.013
min177.485-177.372=0.113
max1323.664-1323.521=0.143
mean77.750
σ7.500
min74.000
max89.000
mean2837.000-2833.000=4.000
σ0.000
min2837.000-2833.000=4.000
max2837.000-2833.000=4.000
mean0.428-0.438=-0.010
σ0.286-0.306=-0.020
min0.284-0.284=-0.000
max0.858-0.897=-0.039
policies=20
mean1775.185-1774.021=1.164
σ0.333-0.324=0.009
min1774.961-1773.813=1.149
max1775.677-1774.502=1.176
mean740.000
σ0.000
min740.000
max740.000
mean2837.000-2833.000=4.000
σ0.000
min2837.000-2833.000=4.000
max2837.000-2833.000=4.000
mean2.831-2.831=-0.001
σ0.013-0.011=0.001
min2.817-2.815=0.002
max2.845-2.840=0.006
policies=200
mean17758.176-17745.754=12.423
σ0.433-0.716=-0.283
min17757.769-17744.719=13.049
max17758.780-17746.281=12.499
mean7400.000
σ0.000
min7400.000
max7400.000
mean2837.000-2833.000=4.000
σ0.000
min2837.000-2833.000=4.000
max2837.000-2833.000=4.000
mean28.205-28.346=-0.141
σ0.561-0.635=-0.074
min27.663-27.710=-0.047
max28.819-29.139=-0.320