Compare commits

Home / Compare 15078f97 .. 867604db

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.768=0.002
σ0.049-0.050=-0.000
min30.730-30.728=0.002
max30.905-30.905=0.000
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.077-0.075=0.002
σ0.003-0.005=-0.002
min0.076-0.070=0.006
max0.084-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=-0.000
σ0.002-0.002=-0.000
min21.057-21.057=0.000
max21.063-21.064=-0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.062-0.062=-0.001
σ0.003-0.003=-0.000
min0.058-0.058=-0.000
max0.069-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.419=0.001
σ0.362-0.362=-0.000
min1750.854-1750.850=0.004
max1752.003-1751.998=0.005
mean1645.500-1659.650=-14.150
σ620.396-635.840=-15.444
min679.000-680.000=-1.000
max2641.000-2694.000=-53.000
mean2.854-2.763=0.091
σ0.171-0.222=-0.051
min2.417-2.287=0.131
max3.140-3.029=0.111

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.758-275.758=-0.000
σ0.012-0.009=0.003
min275.745-275.748=-0.003
max275.773-275.771=0.002
mean2641.000-2694.000=-53.000
σ0.000
min2641.000-2694.000=-53.000
max2641.000-2694.000=-53.000
mean0.401-0.404=-0.002
σ0.010-0.010=0.000
min0.393-0.395=-0.003
max0.416-0.417=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.286-2168.273=0.014
σ0.004-0.023=-0.019
min2168.283-2168.246=0.037
max2168.293-2168.298=-0.005
mean2641.000-2694.000=-53.000
σ0.000
min2641.000-2694.000=-53.000
max2641.000-2694.000=-53.000
mean2.926-2.975=-0.049
σ0.118-0.187=-0.069
min2.737-2.686=0.051
max3.011-3.161=-0.150
iters=5
new-facts=6402
prior-facts=1
mean5048.122-5047.879=0.243
σ0.924-0.812=0.112
min5047.594-5046.988=0.606
max5049.756-5049.210=0.546
mean2641.000-2694.000=-53.000
σ0.000
min2641.000-2694.000=-53.000
max2641.000-2694.000=-53.000
mean9.024-8.950=0.074
σ0.687-0.517=0.171
min8.032-8.196=-0.163
max9.961-9.425=0.536
iters=5
new-facts=6402
prior-facts=6402
mean5179.163-5179.096=0.067
σ0.134-0.201=-0.066
min5178.961-5178.815=0.146
max5179.338-5179.326=0.012
mean3272.200-3275.200=-3.000
σ381.475-381.687=-0.212
min2732.000-2736.000=-4.000
max3730.000-3734.000=-4.000
mean9.980-9.930=0.050
σ0.074-0.172=-0.098
min9.905-9.671=0.234
max10.068-10.072=-0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.317-1.088=0.229
σ0.374-0.146=0.228
min0.949-0.948=0.001
max1.814-1.262=0.552

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.573-463.574=-0.001
σ572.664-572.661=0.002
min177.237-177.240=-0.003
max1322.569-1322.566=0.003
mean79.750
σ7.500
min76.000
max91.000
mean2641.000-2694.000=-53.000
σ0.000
min2641.000-2694.000=-53.000
max2641.000-2694.000=-53.000
mean0.551-0.549=0.002
σ0.546-0.532=0.013
min0.275-0.271=0.004
max1.370-1.347=0.023
policies=20
mean1772.643-1772.647=-0.004
σ0.333-0.328=0.005
min1772.415-1772.419=-0.004
max1773.137-1773.133=0.003
mean760.000
σ0.000
min760.000
max760.000
mean2641.000-2694.000=-53.000
σ0.000
min2641.000-2694.000=-53.000
max2641.000-2694.000=-53.000
mean2.758-2.731=0.026
σ0.006-0.023=-0.017
min2.750-2.698=0.052
max2.763-2.748=0.015
policies=200
mean17733.049-17733.054=-0.004
σ0.461-0.497=-0.036
min17732.768-17732.781=-0.014
max17733.734-17733.798=-0.064
mean7600.000
σ0.000
min7600.000
max7600.000
mean2641.000-2694.000=-53.000
σ0.000
min2641.000-2694.000=-53.000
max2641.000-2694.000=-53.000
mean27.738-27.761=-0.023
σ0.171-0.167=0.003
min27.617-27.615=0.001
max27.991-27.970=0.021