Compare commits

Home / Compare be00e6bd .. c19ad866

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.982-33.983=-0.001
σ0.047-0.049=-0.002
min33.955-33.957=-0.002
max34.112-34.118=-0.005
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.082-0.085=-0.003
σ0.005-0.003=0.002
min0.076-0.082=-0.006
max0.091-0.091=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.316-23.318=-0.002
σ0.003-0.003=0.000
min23.313-23.315=-0.002
max23.321-23.322=-0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.065-0.067=-0.002
σ0.002-0.003=-0.001
min0.061-0.064=-0.004
max0.070-0.075=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.429=-0.000
σ0.365-0.365=-0.000
min1756.855-1756.857=-0.003
max1758.012-1758.018=-0.006
mean1648.750-1653.500=-4.750
σ629.705-629.490=0.216
min638.000-643.000=-5.000
max2822.000-2827.000=-5.000
mean2.372-2.383=-0.010
σ0.130-0.111=0.019
min2.126-2.272=-0.146
max2.706-2.793=-0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.575-326.574=0.000
σ0.049-0.054=-0.005
min326.490-326.478=0.012
max326.617-326.613=0.005
mean2822.000-2827.000=-5.000
σ0.000
min2822.000-2827.000=-5.000
max2822.000-2827.000=-5.000
mean0.424-0.425=-0.001
σ0.004-0.007=-0.003
min0.420-0.419=0.001
max0.429-0.436=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1988.737-1988.731=0.006
σ0.016-0.023=-0.008
min1988.715-1988.700=0.015
max1988.751-1988.757=-0.005
mean2822.000-2827.000=-5.000
σ0.000
min2822.000-2827.000=-5.000
max2822.000-2827.000=-5.000
mean2.668-2.712=-0.044
σ0.081-0.160=-0.079
min2.553-2.566=-0.012
max2.777-2.980=-0.204
iters=5
new-facts=6402
prior-facts=1
mean4813.429-4813.550=-0.121
σ7.696-7.664=0.031
min4809.512-4810.069=-0.557
max4827.186-4827.259=-0.073
mean2822.000-2827.000=-5.000
σ0.000
min2822.000-2827.000=-5.000
max2822.000-2827.000=-5.000
mean8.775-8.946=-0.171
σ0.263-0.293=-0.029
min8.476-8.605=-0.129
max9.156-9.263=-0.107
iters=5
new-facts=6402
prior-facts=6402
mean5001.136-5001.150=-0.014
σ0.023-0.036=-0.012
min5001.115-5001.117=-0.002
max5001.174-5001.191=-0.017
mean3022.200-3015.800=6.400
σ204.910-199.888=5.022
min2822.000-2827.000=-5.000
max3307.000
mean9.743-9.907=-0.164
σ0.290-0.402=-0.112
min9.241-9.476=-0.235
max9.979-10.501=-0.522

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.972-1.044=-0.072
σ0.068-0.091=-0.023
min0.912-0.922=-0.010
max1.052-1.179=-0.127

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.333-464.335=-0.001
σ574.297-574.296=0.001
min177.176-177.177=-0.001
max1325.778-1325.779=-0.000
mean88.250
σ8.500
min84.000
max101.000
mean2822.000-2827.000=-5.000
σ0.000
min2822.000-2827.000=-5.000
max2822.000-2827.000=-5.000
mean0.434-0.437=-0.003
σ0.302-0.304=-0.003
min0.282-0.284=-0.002
max0.886-0.893=-0.007
policies=20
mean1772.072-1772.071=0.002
σ0.359-0.360=-0.001
min1771.831-1771.821=0.010
max1772.605-1772.603=0.002
mean840.000
σ0.000
min840.000
max840.000
mean2822.000-2827.000=-5.000
σ0.000
min2822.000-2827.000=-5.000
max2822.000-2827.000=-5.000
mean2.796-2.793=0.003
σ0.012-0.005=0.007
min2.787-2.787=0.000
max2.814-2.798=0.016
policies=200
mean17727.649-17727.515=0.134
σ0.495-0.560=-0.065
min17727.259-17727.141=0.118
max17728.365-17728.347=0.017
mean8400.000
σ0.000
min8400.000
max8400.000
mean2822.000-2827.000=-5.000
σ0.000
min2822.000-2827.000=-5.000
max2822.000-2827.000=-5.000
mean27.903-27.882=0.021
σ0.379-0.343=0.037
min27.579-27.597=-0.018
max28.360-28.320=0.040