Compare commits

Home / Compare d5cf3892 .. e99049f9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.769=-0.000
σ0.046-0.047=-0.001
min30.731-30.734=-0.002
max30.894-30.899=-0.004
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.078-0.075=0.003
σ0.002-0.005=-0.002
min0.076-0.070=0.007
max0.084-0.082=0.002
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.001
σ0.002-0.002=-0.000
min21.057
max21.063-21.064=-0.001
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.061-0.063=-0.002
σ0.003-0.002=0.001
min0.058-0.061=-0.003
max0.069-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.418=0.002
σ0.363-0.360=0.004
min1750.854-1750.851=0.002
max1752.006-1751.999=0.007
mean1645.750-1661.650=-15.900
σ621.071-622.614=-1.542
min678.000-638.000=40.000
max2642.000-2509.000=133.000
mean2.842-2.775=0.067
σ0.138-0.224=-0.086
min2.443-2.276=0.167
max3.012-3.049=-0.037

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.759-275.756=0.003
σ0.009-0.007=0.002
min275.751-275.750=0.001
max275.768-275.764=0.004
mean2642.000-2509.000=133.000
σ0.000
min2642.000-2509.000=133.000
max2642.000-2509.000=133.000
mean0.406-0.404=0.001
σ0.012-0.009=0.003
min0.395-0.399=-0.004
max0.420-0.420=0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.288-2168.275=0.013
σ0.007-0.019=-0.012
min2168.277-2168.256=0.022
max2168.296-2168.299=-0.003
mean2642.000-2509.000=133.000
σ0.000
min2642.000-2509.000=133.000
max2642.000-2509.000=133.000
mean2.954-2.940=0.014
σ0.155-0.109=0.046
min2.750-2.792=-0.042
max3.107-3.082=0.025
iters=5
new-facts=6402
prior-facts=1
mean5047.874-5048.102=-0.228
σ1.168-0.928=0.239
min5046.579-5047.606=-1.026
max5049.781-5049.755=0.027
mean2642.000-2509.000=133.000
σ0.000
min2642.000-2509.000=133.000
max2642.000-2509.000=133.000
mean8.697-9.041=-0.345
σ0.459-0.342=0.117
min8.068-8.550=-0.482
max9.184-9.478=-0.294
iters=5
new-facts=6402
prior-facts=6402
mean5179.237-5179.022=0.215
σ0.069-0.251=-0.182
min5179.170-5178.614=0.556
max5179.314-5179.197=0.117
mean3228.400-3269.400=-41.000
σ389.712-380.467=9.245
min2686.000-2731.000=-45.000
max3719.000-3726.000=-7.000
mean9.696-9.901=-0.205
σ0.553-0.660=-0.106
min8.915-8.870=0.045
max10.249-10.531=-0.282

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.304-1.686=-0.382
σ0.464-0.146=0.318
min0.931-1.465=-0.534
max1.987-1.844=0.144

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.573-463.566=0.007
σ572.663-572.652=0.011
min177.236-177.237=-0.000
max1322.567-1322.544=0.023
mean79.750
σ7.500
min76.000
max91.000
mean2642.000-2509.000=133.000
σ0.000
min2642.000-2509.000=133.000
max2642.000-2509.000=133.000
mean0.555-0.557=-0.002
σ0.542-0.566=-0.024
min0.276-0.272=0.004
max1.368-1.405=-0.038
policies=20
mean1772.647-1772.617=0.031
σ0.335-0.339=-0.004
min1772.417-1772.391=0.027
max1773.144-1773.119=0.024
mean760.000
σ0.000
min760.000
max760.000
mean2642.000-2509.000=133.000
σ0.000
min2642.000-2509.000=133.000
max2642.000-2509.000=133.000
mean2.779-2.746=0.033
σ0.024-0.010=0.014
min2.759-2.736=0.022
max2.812-2.760=0.052
policies=200
mean17732.908-17732.902=0.006
σ0.585-0.473=0.111
min17732.587-17732.550=0.037
max17733.785-17733.601=0.184
mean7600.000
σ0.000
min7600.000
max7600.000
mean2642.000-2509.000=133.000
σ0.000
min2642.000-2509.000=133.000
max2642.000-2509.000=133.000
mean27.931-27.701=0.230
σ0.122-0.148=-0.027
min27.811-27.590=0.221
max28.088-27.915=0.173