Compare commits

Home / Compare f05867b4 .. 037238d7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.990-35.993=-0.002
σ0.103-0.103=-0.001
min35.949-35.947=0.002
max36.282-36.286=-0.004
mean4180.000-3922.000=258.000
σ0.000
min4180.000-3922.000=258.000
max4180.000-3922.000=258.000
mean0.076-0.076=-0.000
σ0.001-0.002=-0.001
min0.075-0.074=0.000
max0.077-0.080=-0.004
cache=y
dps=1
iters=10
policies=100
mean26.215-26.213=0.002
σ0.003-0.005=-0.002
min26.210-26.204=0.006
max26.220-26.220=-0.000
mean4180.000-3922.000=258.000
σ0.000
min4180.000-3922.000=258.000
max4180.000-3922.000=258.000
mean0.060-0.059=0.002
σ0.000-0.002=-0.002
min0.060-0.055=0.004
max0.061-0.061=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.370-1756.369=0.001
σ0.374-0.373=0.001
min1755.791-1755.791=0.000
max1756.967-1756.967=-0.001
mean1660.200-1656.450=3.750
σ637.117-626.535=10.583
min619.000-617.000=2.000
max2693.000-2635.000=58.000
mean2.301-2.278=0.023
σ0.181-0.179=0.002
min2.121-2.126=-0.005
max2.772-2.782=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.698-278.699=-0.001
σ0.013-0.014=-0.001
min278.689-278.686=0.003
max278.720-278.722=-0.002
mean2693.000-2635.000=58.000
σ0.000
min2693.000-2635.000=58.000
max2693.000-2635.000=58.000
mean0.419-0.419=0.000
σ0.001-0.001=0.000
min0.418-0.418=-0.001
max0.420-0.421=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2268.871-2268.875=-0.004
σ0.006-0.006=-0.001
min2268.865-2268.864=0.001
max2268.878-2268.880=-0.002
mean2693.000-2635.000=58.000
σ0.000
min2693.000-2635.000=58.000
max2693.000-2635.000=58.000
mean3.093-2.889=0.204
σ0.219-0.061=0.159
min2.883-2.803=0.080
max3.411-2.973=0.437
iters=5
new-facts=6402
prior-facts=1
mean4952.078-4952.213=-0.135
σ0.909-0.784=0.124
min4951.145-4951.833=-0.688
max4953.599-4953.615=-0.016
mean2693.000-2635.000=58.000
σ0.000
min2693.000-2635.000=58.000
max2693.000-2635.000=58.000
mean8.077-7.825=0.252
σ0.237-0.134=0.103
min7.858-7.678=0.180
max8.346-7.968=0.378
iters=5
new-facts=6402
prior-facts=6402
mean5166.848-5166.915=-0.067
σ0.162-0.011=0.151
min5166.560-5166.906=-0.346
max5166.939-5166.933=0.006
mean3467.000-3354.400=112.600
σ509.392-436.874=72.518
min2834.000-2768.000=66.000
max4180.000-3922.000=258.000
mean9.280-9.144=0.136
σ0.511-0.362=0.150
min8.481-8.841=-0.360
max9.727-9.614=0.113

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.061-1.061=-0.001
σ0.126-0.222=-0.097
min0.946-0.928=0.018
max1.252-1.448=-0.196

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.262-460.260=0.002
σ572.607-572.605=0.003
min173.957-173.953=0.003
max1319.173-1319.167=0.006
mean79.500
σ7.000
min76.000
max90.000
mean436.000-435.000=1.000
σ0.000
min436.000-435.000=1.000
max436.000-435.000=1.000
mean0.554-0.557=-0.003
σ0.553-0.565=-0.012
min0.275-0.266=0.009
max1.383-1.404=-0.021
policies=20
mean1740.078-1740.081=-0.004
σ0.333-0.334=-0.001
min1739.839-1739.840=-0.001
max1740.567-1740.571=-0.004
mean760.000
σ0.000
min760.000
max760.000
mean447.000-446.000=1.000
σ10.520
min436.000-435.000=1.000
max456.000-455.000=1.000
mean2.673-2.666=0.007
σ0.016-0.016=-0.000
min2.652-2.646=0.007
max2.687-2.680=0.007
policies=200
mean17410.021-17409.955=0.066
σ0.063-0.101=-0.038
min17409.970-17409.860=0.110
max17410.112-17410.097=0.014
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.250-489.500=1.750
σ2.500-2.380=0.120
min488.000-487.000=1.000
max494.000-492.000=2.000
mean26.856-26.939=-0.083
σ0.156-0.193=-0.037
min26.709-26.775=-0.066
max27.067-27.216=-0.149