Compare commits

Home / Compare 6342698d .. 10ae31fb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.957-35.957=0.001
σ0.103-0.102=0.001
min35.915-35.916=-0.001
max36.250-36.248=0.002
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.078-0.074=0.004
σ0.004-0.004=-0.000
min0.075-0.070=0.005
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean26.202-26.203=-0.001
σ0.005-0.004=0.001
min26.196-26.198=-0.002
max26.211-26.211=0.000
mean413.000-417.900=-4.900
σ0.000-0.316=-0.316
min413.000-417.000=-4.000
max413.000-418.000=-5.000
mean0.060-0.059=0.001
σ0.004-0.003=0.001
min0.057-0.056=0.001
max0.069-0.066=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.303-1756.305=-0.002
σ0.369-0.369=0.001
min1755.728-1755.729=-0.002
max1756.900-1756.897=0.003
mean1679.950-1670.000=9.950
σ639.339-628.342=10.996
min680.000-685.000=-5.000
max2700.000-2695.000=5.000
mean2.375-2.398=-0.023
σ0.072-0.089=-0.018
min2.283-2.232=0.051
max2.536-2.537=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.827-278.817=0.010
σ0.005-0.015=-0.010
min278.818-278.792=0.026
max278.832-278.829=0.003
mean2700.000-2695.000=5.000
σ0.000
min2700.000-2695.000=5.000
max2700.000-2695.000=5.000
mean0.410-0.425=-0.014
σ0.006-0.009=-0.003
min0.406-0.409=-0.003
max0.418-0.431=-0.013
iters=5
new-facts=1
prior-facts=6402
mean2268.878-2268.881=-0.003
σ0.019-0.007=0.011
min2268.846-2268.871=-0.026
max2268.892-2268.892=-0.000
mean2700.000-2695.000=5.000
σ0.000
min2700.000-2695.000=5.000
max2700.000-2695.000=5.000
mean2.936-2.966=-0.030
σ0.097-0.075=0.022
min2.842-2.911=-0.069
max3.099-3.096=0.002
iters=5
new-facts=6402
prior-facts=1
mean4954.028-4954.275=-0.247
σ1.095-1.035=0.060
min4953.163-4953.573=-0.410
max4955.881-4956.100=-0.219
mean2700.000-2695.000=5.000
σ0.000
min2700.000-2695.000=5.000
max2700.000-2695.000=5.000
mean8.077-8.308=-0.231
σ0.273-0.565=-0.292
min7.671-7.691=-0.019
max8.382-9.233=-0.851
iters=5
new-facts=6402
prior-facts=6402
mean5168.823-5168.821=0.002
σ0.086-0.090=-0.005
min5168.724-5168.720=0.004
max5168.893-5168.900=-0.007
mean3450.600-3399.800=50.800
σ482.687-461.109=21.578
min2807.000-2814.000=-7.000
max4072.000-4016.000=56.000
mean9.177-9.337=-0.161
σ0.262-0.262=-0.000
min8.848-8.957=-0.109
max9.473-9.655=-0.182

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.157-1.133=0.025
σ0.243-0.137=0.106
min0.939-0.951=-0.011
max1.479-1.277=0.202

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.817-459.815=0.002
σ571.586-571.586=0.000
min174.017-174.015=0.003
max1317.196-1317.193=0.003
mean79.500
σ7.000
min76.000
max90.000
mean2700.000-2695.000=5.000
σ0.000
min2700.000-2695.000=5.000
max2700.000-2695.000=5.000
mean0.540-0.563=-0.023
σ0.546-0.583=-0.037
min0.265-0.268=-0.003
max1.358-1.437=-0.078
policies=20
mean1740.408-1740.420=-0.012
σ0.315-0.331=-0.015
min1740.204-1740.194=0.010
max1740.878-1740.910=-0.032
mean760.000
σ0.000
min760.000
max760.000
mean2700.000-2695.000=5.000
σ0.000
min2700.000-2695.000=5.000
max2700.000-2695.000=5.000
mean2.684-2.689=-0.006
σ0.011-0.006=0.005
min2.675-2.681=-0.005
max2.699-2.694=0.005
policies=200
mean17411.265-17411.274=-0.009
σ0.489-0.473=0.016
min17410.965-17411.034=-0.069
max17411.995-17411.983=0.012
mean7600.000
σ0.000
min7600.000
max7600.000
mean2700.000-2695.000=5.000
σ0.000
min2700.000-2695.000=5.000
max2700.000-2695.000=5.000
mean27.039-27.059=-0.020
σ0.039-0.062=-0.023
min26.996-26.996=-0.000
max27.076-27.144=-0.068