Compare commits

Home / Compare 184bceed .. ed58a209

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727-36.727=0.000
σ0.583-0.614=-0.031
min35.921-35.929=-0.008
max37.219-37.220=-0.001
mean3934.000-3986.000=-52.000
σ0.000
min3934.000-3986.000=-52.000
max3934.000-3986.000=-52.000
mean0.075-0.076=-0.001
σ0.001-0.002=-0.002
min0.074-0.072=0.002
max0.076-0.080=-0.004
cache=y
dps=1
iters=10
policies=100
mean26.712-26.711=0.002
σ0.645-0.646=-0.001
min26.207-26.207=0.001
max27.465-27.463=0.002
mean3934.000-3986.000=-52.000
σ0.000
min3934.000-3986.000=-52.000
max3934.000-3986.000=-52.000
mean0.060-0.060=0.000
σ0.001-0.002=-0.002
min0.059-0.056=0.003
max0.061-0.063=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.367-1756.368=-0.001
σ0.373-0.373=-0.000
min1755.789-1755.800=-0.011
max1756.974-1756.968=0.006
mean1668.550-1658.400=10.150
σ649.813-627.666=22.147
min619.000-684.000=-65.000
max2645.000-2609.000=36.000
mean2.280-2.269=0.011
σ0.171-0.152=0.019
min2.106-2.157=-0.051
max2.751-2.792=-0.041

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.697-278.701=-0.004
σ0.013-0.010=0.003
min278.684-278.693=-0.010
max278.718-278.718=-0.001
mean2645.000-2609.000=36.000
σ0.000
min2645.000-2609.000=36.000
max2645.000-2609.000=36.000
mean0.418-0.415=0.003
σ0.001-0.002=-0.000
min0.416-0.414=0.002
max0.419-0.418=0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.875-2268.872=0.003
σ0.010-0.004=0.006
min2268.866-2268.868=-0.002
max2268.888-2268.877=0.011
mean2645.000-2609.000=36.000
σ0.000
min2645.000-2609.000=36.000
max2645.000-2609.000=36.000
mean2.910-2.908=0.003
σ0.170-0.087=0.083
min2.756-2.768=-0.012
max3.173-3.005=0.168
iters=5
new-facts=6402
prior-facts=1
mean4952.362-4952.360=0.002
σ0.816-0.865=-0.049
min4951.964-4951.879=0.085
max4953.821-4953.904=-0.083
mean2645.000-2609.000=36.000
σ0.000
min2645.000-2609.000=36.000
max2645.000-2609.000=36.000
mean7.925-7.985=-0.060
σ0.139-0.297=-0.158
min7.723-7.719=0.004
max8.041-8.468=-0.427
iters=5
new-facts=6402
prior-facts=6402
mean5167.004-5167.004=0.001
σ0.147-0.150=-0.004
min5166.742-5166.735=0.007
max5167.078-5167.079=-0.001
mean3391.800-3384.000=7.800
σ443.929-479.347=-35.418
min2768.000-2729.000=39.000
max3934.000-3986.000=-52.000
mean9.501-9.336=0.165
σ0.142-0.195=-0.054
min9.410-9.113=0.296
max9.749-9.586=0.163

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.080=-0.052
σ0.135-0.110=0.025
min0.935-0.940=-0.005
max1.248-1.249=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.260-460.261=-0.000
σ572.608-572.607=0.001
min173.954-173.956=-0.002
max1319.172-1319.171=0.001
mean79.500
σ7.000
min76.000
max90.000
mean435.000
σ0.000
min435.000
max435.000
mean0.547-0.565=-0.018
σ0.547-0.584=-0.037
min0.268-0.267=0.001
max1.367-1.441=-0.074
policies=20
mean1740.056-1740.066=-0.010
σ0.317-0.334=-0.017
min1739.828-1739.823=0.005
max1740.520-1740.556=-0.036
mean760.000
σ0.000
min760.000
max760.000
mean445.000-445.500=-0.500
σ9.381-9.950=-0.569
min435.000
max453.000-454.000=-1.000
mean2.650-2.662=-0.012
σ0.017-0.013=0.004
min2.631-2.645=-0.014
max2.666-2.677=-0.011
policies=200
mean17409.966-17409.837=0.129
σ0.059-0.052=0.007
min17409.879-17409.788=0.090
max17410.002-17409.911=0.091
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.750-491.250=0.500
σ3.500-4.113=-0.613
min488.000-486.000=2.000
max496.000-495.000=1.000
mean27.033-26.836=0.197
σ0.147-0.069=0.078
min26.875-26.783=0.092
max27.229-26.932=0.297