Compare commits

Home / Compare 36da23fc .. 97d1092b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.957-35.952=0.005
σ0.101-0.103=-0.003
min35.914-35.912=0.003
max36.243-36.245=-0.002
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.078-0.077=0.001
σ0.004-0.004=0.000
min0.074-0.074=0.000
max0.084-0.085=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.203-26.200=0.002
σ0.005-0.004=0.001
min26.196-26.196=-0.000
max26.212-26.207=0.005
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.061-0.060=0.001
σ0.003-0.002=0.000
min0.060-0.059=0.001
max0.068-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.303-1756.299=0.004
σ0.368-0.370=-0.002
min1755.729-1755.723=0.006
max1756.901-1756.895=0.007
mean1658.200-1640.700=17.500
σ637.823-635.116=2.708
min612.000-617.000=-5.000
max2692.000-2685.000=7.000
mean2.382-2.338=0.044
σ0.198-0.105=0.093
min2.131-2.185=-0.053
max3.077-2.594=0.482

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.807-278.817=-0.010
σ0.030-0.004=0.026
min278.753-278.810=-0.057
max278.822-278.820=0.002
mean2692.000-2685.000=7.000
σ0.000
min2692.000-2685.000=7.000
max2692.000-2685.000=7.000
mean0.410-0.411=-0.000
σ0.001-0.005=-0.004
min0.409-0.406=0.003
max0.412-0.417=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2268.883-2268.880=0.003
σ0.010-0.019=-0.009
min2268.872-2268.849=0.023
max2268.899-2268.896=0.003
mean2692.000-2685.000=7.000
σ0.000
min2692.000-2685.000=7.000
max2692.000-2685.000=7.000
mean3.006-3.157=-0.151
σ0.149-0.215=-0.065
min2.899-2.913=-0.015
max3.256-3.390=-0.133
iters=5
new-facts=6402
prior-facts=1
mean4954.259-4954.024=0.235
σ0.966-1.123=-0.157
min4953.665-4952.648=1.017
max4955.970-4955.781=0.189
mean2692.000-2685.000=7.000
σ0.000
min2692.000-2685.000=7.000
max2692.000-2685.000=7.000
mean8.160-7.943=0.217
σ0.407-0.409=-0.001
min7.715-7.665=0.051
max8.759-8.655=0.105
iters=5
new-facts=6402
prior-facts=6402
mean5168.751-5168.782=-0.031
σ0.151-0.084=0.067
min5168.536-5168.717=-0.181
max5168.909-5168.875=0.034
mean3447.800-3319.600=128.200
σ473.000-394.553=78.446
min2864.000-2928.000=-64.000
max4132.000-3717.000=415.000
mean9.201-9.182=0.019
σ0.363-0.194=0.169
min8.728-8.973=-0.244
max9.628-9.403=0.225

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.103-0.970=0.133
σ0.274-0.054=0.220
min0.936-0.941=-0.005
max1.581-1.065=0.516

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.822-459.807=0.014
σ571.590-571.582=0.007
min174.016-174.006=0.011
max1317.206-1317.181=0.025
mean79.500
σ7.000
min76.000
max90.000
mean2692.000-2685.000=7.000
σ0.000
min2692.000-2685.000=7.000
max2692.000-2685.000=7.000
mean0.539-0.537=0.001
σ0.541-0.538=0.003
min0.267-0.267=0.001
max1.350-1.344=0.005
policies=20
mean1740.426-1740.313=0.113
σ0.315-0.304=0.011
min1740.220-1740.131=0.089
max1740.895-1740.767=0.127
mean760.000
σ0.000
min760.000
max760.000
mean2692.000-2685.000=7.000
σ0.000
min2692.000-2685.000=7.000
max2692.000-2685.000=7.000
mean2.690-2.669=0.021
σ0.017-0.018=-0.001
min2.677-2.650=0.027
max2.712-2.688=0.024
policies=200
mean17411.290-17410.205=1.085
σ0.495-0.485=0.010
min17411.033-17409.944=1.090
max17412.032-17410.932=1.100
mean7600.000
σ0.000
min7600.000
max7600.000
mean2692.000-2685.000=7.000
σ0.000
min2692.000-2685.000=7.000
max2692.000-2685.000=7.000
mean27.128-26.955=0.173
σ0.052-0.099=-0.048
min27.070-26.836=0.234
max27.189-27.066=0.122