Compare commits

Home / Compare c24b7204 .. a4bd7c7a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.963-35.973=-0.010
σ0.106-0.107=-0.001
min35.912-35.922=-0.010
max36.263-36.276=-0.012
mean413.900-413.000=0.900
σ0.316-0.000=0.316
min413.000
max414.000-413.000=1.000
mean0.076-0.078=-0.002
σ0.005-0.004=0.001
min0.070-0.075=-0.005
max0.083-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.201-26.208=-0.007
σ0.002-0.002=0.000
min26.198-26.204=-0.006
max26.205-26.211=-0.006
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.061-0.061=-0.001
σ0.003-0.003=-0.000
min0.059-0.059=-0.000
max0.068-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.263-1758.362=-0.100
σ0.372-0.372=0.000
min1757.686-1757.786=-0.099
max1758.857-1758.961=-0.104
mean1645.850-1655.150=-9.300
σ638.968-620.424=18.543
min673.000-685.000=-12.000
max2730.000-2746.000=-16.000
mean2.386-2.368=0.018
σ0.102-0.114=-0.012
min2.262-2.178=0.084
max2.603-2.634=-0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.318-279.512=-0.194
σ0.006-0.007=-0.001
min279.310-279.503=-0.193
max279.324-279.517=-0.194
mean2730.000-2746.000=-16.000
σ0.000
min2730.000-2746.000=-16.000
max2730.000-2746.000=-16.000
mean0.412-0.409=0.003
σ0.006-0.002=0.004
min0.407-0.405=0.002
max0.419-0.410=0.009
iters=5
new-facts=1
prior-facts=6402
mean2178.262-2178.418=-0.156
σ0.023-0.034=-0.010
min2178.221-2178.359=-0.139
max2178.277-2178.443=-0.166
mean2730.000-2746.000=-16.000
σ0.000
min2730.000-2746.000=-16.000
max2730.000-2746.000=-16.000
mean3.332-3.432=-0.100
σ0.130-0.172=-0.042
min3.232-3.271=-0.039
max3.559-3.620=-0.061
iters=5
new-facts=6402
prior-facts=1
mean5047.799-5056.392=-8.593
σ1.116-1.004=0.112
min5046.722-5055.790=-9.068
max5049.687-5058.177=-8.491
mean2730.000-2746.000=-16.000
σ0.000
min2730.000-2746.000=-16.000
max2730.000-2746.000=-16.000
mean8.799-8.715=0.085
σ0.540-0.657=-0.117
min8.105-8.163=-0.058
max9.445-9.736=-0.291
iters=5
new-facts=6402
prior-facts=6402
mean5185.171-5193.689=-8.518
σ0.259-0.212=0.047
min5184.889-5193.338=-8.449
max5185.411-5193.874=-8.463
mean3191.400-3285.800=-94.400
σ355.151-404.146=-48.995
min2820.000-2746.000=74.000
max3735.000-3673.000=62.000
mean9.002-8.832=0.169
σ0.473-0.095=0.378
min8.611-8.705=-0.095
max9.767-8.970=0.796

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.032-1.001=0.031
σ0.072-0.072=0.001
min0.941-0.937=0.003
max1.087-1.080=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.344-465.476=-0.131
σ572.655-572.661=-0.006
min179.007-179.137=-0.130
max1324.327-1324.468=-0.140
mean79.500
σ7.000
min76.000
max90.000
mean2730.000-2746.000=-16.000
σ0.000
min2730.000-2746.000=-16.000
max2730.000-2746.000=-16.000
mean0.560-0.474=0.086
σ0.543-0.379=0.164
min0.282-0.282=-0.000
max1.374-1.042=0.332
policies=20
mean1790.329-1791.671=-1.342
σ0.345-0.340=0.005
min1790.103-1791.474=-1.371
max1790.841-1792.178=-1.337
mean760.000
σ0.000
min760.000
max760.000
mean2730.000-2746.000=-16.000
σ0.000
min2730.000-2746.000=-16.000
max2730.000-2746.000=-16.000
mean2.810-2.818=-0.008
σ0.018-0.006=0.011
min2.792-2.811=-0.019
max2.828-2.824=0.004
policies=200
mean17910.038-17923.168=-13.130
σ0.510-0.510=-0.001
min17909.637-17922.880=-13.243
max17910.785-17923.933=-13.148
mean7600.000
σ0.000
min7600.000
max7600.000
mean2730.000-2746.000=-16.000
σ0.000
min2730.000-2746.000=-16.000
max2730.000-2746.000=-16.000
mean28.260-28.237=0.023
σ0.128-0.094=0.034
min28.146-28.152=-0.006
max28.385-28.368=0.017