Compare commits

Home / Compare c8250065 .. f5510d22

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.975=-0.176
σ0.108-0.106=0.002
min35.749-35.928=-0.179
max36.104-36.276=-0.172
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.076-0.078=-0.002
σ0.004-0.004=0.000
min0.071-0.075=-0.004
max0.083-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.064-26.209=-0.145
σ0.003-0.004=-0.001
min26.059-26.203=-0.144
max26.069-26.215=-0.146
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.059-0.062=-0.003
σ0.003-0.002=0.001
min0.056-0.061=-0.004
max0.067-0.069=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.922-1758.363=-2.441
σ0.365-0.372=-0.007
min1755.355-1757.790=-2.435
max1756.495-1758.964=-2.469
mean1666.150-1657.250=8.900
σ628.292-623.575=4.717
min670.000-686.000=-16.000
max2609.000-2768.000=-159.000
mean2.788-2.375=0.414
σ0.197-0.098=0.099
min2.179-2.268=-0.089
max3.050-2.603=0.447

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.197-279.508=-2.311
σ0.007-0.005=0.002
min277.189-279.502=-2.313
max277.204-279.515=-2.311
mean2609.000-2768.000=-159.000
σ0.000
min2609.000-2768.000=-159.000
max2609.000-2768.000=-159.000
mean0.407-0.409=-0.002
σ0.009-0.007=0.002
min0.401-0.403=-0.002
max0.418-0.419=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2174.402-2178.430=-4.027
σ0.052-0.011=0.042
min2174.310-2178.419=-4.109
max2174.434-2178.443=-4.009
mean2609.000-2768.000=-159.000
σ0.000
min2609.000-2768.000=-159.000
max2609.000-2768.000=-159.000
mean2.829-3.327=-0.499
σ0.100-0.117=-0.017
min2.740-3.200=-0.460
max3.000-3.465=-0.465
iters=5
new-facts=6402
prior-facts=1
mean5052.652-5056.368=-3.717
σ0.995-0.975=0.020
min5052.093-5055.758=-3.665
max5054.419-5058.098=-3.679
mean2609.000-2768.000=-159.000
σ0.000
min2609.000-2768.000=-159.000
max2609.000-2768.000=-159.000
mean8.642-9.171=-0.529
σ0.647-0.515=0.132
min8.095-8.278=-0.183
max9.707-9.549=0.158
iters=5
new-facts=6402
prior-facts=6402
mean5188.347-5193.742=-5.395
σ0.208-0.069=0.139
min5188.005-5193.689=-5.685
max5188.515-5193.852=-5.338
mean3230.800-3288.000=-57.200
σ538.200-383.766=154.434
min2609.000-2768.000=-159.000
max3961.000-3654.000=307.000
mean8.843-9.123=-0.279
σ0.224-0.461=-0.237
min8.625-8.819=-0.194
max9.211-9.940=-0.729

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.360-0.980=0.380
σ0.307-0.056=0.251
min1.069-0.945=0.124
max1.726-1.079=0.647

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.852-465.483=-0.630
σ572.658-572.668=-0.010
min178.518-179.140=-0.622
max1323.839-1324.485=-0.646
mean79.500
σ7.000
min76.000
max90.000
mean2609.000-2768.000=-159.000
σ0.000
min2609.000-2768.000=-159.000
max2609.000-2768.000=-159.000
mean0.573-0.480=0.093
σ0.577-0.396=0.181
min0.279-0.278=0.001
max1.438-1.074=0.364
policies=20
mean1785.463-1791.702=-6.239
σ0.356-0.327=0.029
min1785.229-1791.501=-6.272
max1785.992-1792.187=-6.195
mean760.000
σ0.000
min760.000
max760.000
mean2609.000-2768.000=-159.000
σ0.000
min2609.000-2768.000=-159.000
max2609.000-2768.000=-159.000
mean2.791-2.801=-0.011
σ0.009-0.051=-0.042
min2.786-2.756=0.030
max2.805-2.875=-0.071
policies=200
mean17861.414-17923.398=-61.984
σ0.412-0.363=0.048
min17861.101-17923.207=-62.107
max17862.007-17923.943=-61.936
mean7600.000
σ0.000
min7600.000
max7600.000
mean2609.000-2768.000=-159.000
σ0.000
min2609.000-2768.000=-159.000
max2609.000-2768.000=-159.000
mean28.182-28.212=-0.029
σ0.142-0.136=0.006
min28.090-28.083=0.008
max28.392-28.330=0.062