Compare commits

Home / Compare 3d93aca6 .. 135f5f6f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727-36.726=0.001
σ1.329-0.680=0.649
min35.920-35.934=-0.015
max39.691-37.524=2.167
mean3747.000-3790.000=-43.000
σ0.000
min3747.000-3790.000=-43.000
max3747.000-3790.000=-43.000
mean0.073-0.074=-0.001
σ0.003-0.004=-0.000
min0.070-0.070=-0.001
max0.078-0.080=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.586-26.711=-0.125
σ0.605-0.645=-0.040
min26.206-26.208=-0.002
max27.464-27.465=-0.001
mean3747.000-3790.000=-43.000
σ0.000
min3747.000-3790.000=-43.000
max3747.000-3790.000=-43.000
mean0.060-0.061=-0.001
σ0.000-0.002=-0.002
min0.060-0.059=0.000
max0.061-0.065=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.356-1756.357=-0.000
σ0.373-0.373=0.001
min1755.778-1755.783=-0.005
max1756.945-1756.945=-0.000
mean1661.300-1644.300=17.000
σ628.600-621.596=7.005
min616.000-638.000=-22.000
max2676.000-2846.000=-170.000
mean2.278-2.271=0.007
σ0.160-0.136=0.025
min2.151-2.129=0.022
max2.772-2.747=0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.677-278.672=0.004
σ0.008-0.011=-0.003
min278.667-278.664=0.003
max278.688-278.691=-0.003
mean2676.000-2846.000=-170.000
σ0.000
min2676.000-2846.000=-170.000
max2676.000-2846.000=-170.000
mean0.419-0.418=0.001
σ0.006-0.002=0.004
min0.416-0.415=0.001
max0.429-0.420=0.009
iters=5
new-facts=1
prior-facts=6402
mean2268.842-2268.832=0.010
σ0.010-0.017=-0.007
min2268.826-2268.810=0.016
max2268.851-2268.845=0.006
mean2676.000-2846.000=-170.000
σ0.000
min2676.000-2846.000=-170.000
max2676.000-2846.000=-170.000
mean3.229-3.245=-0.015
σ0.294-0.068=0.226
min2.867-3.188=-0.320
max3.689-3.339=0.350
iters=5
new-facts=6402
prior-facts=1
mean4952.111-4952.340=-0.230
σ0.238-0.751=-0.513
min4951.967-4951.978=-0.011
max4952.529-4953.683=-1.154
mean2676.000-2846.000=-170.000
σ0.000
min2676.000-2846.000=-170.000
max2676.000-2846.000=-170.000
mean7.766-7.715=0.051
σ0.163-0.132=0.031
min7.624-7.547=0.077
max7.978-7.869=0.109
iters=5
new-facts=6402
prior-facts=6402
mean5166.985-5167.051=-0.066
σ0.164-0.008=0.155
min5166.696-5167.042=-0.346
max5167.098-5167.063=0.034
mean3335.400-3365.200=-29.800
σ416.644-421.086=-4.442
min2914.000-2948.000=-34.000
max3747.000-3790.000=-43.000
mean9.324-9.434=-0.110
σ0.629-0.215=0.413
min8.968-9.163=-0.195
max10.432-9.663=0.769

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.731-1.633=0.098
σ0.069-0.321=-0.252
min1.632-1.247=0.385
max1.803-1.946=-0.144

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.255-460.255=-0.000
σ572.608-572.607=0.000
min173.949-173.950=-0.001
max1319.166-1319.166=0.000
mean79.500
σ7.000
min76.000
max90.000
mean437.000-436.000=1.000
σ0.000
min437.000-436.000=1.000
max437.000-436.000=1.000
mean0.565-0.546=0.019
σ0.578-0.523=0.055
min0.270-0.279=-0.009
max1.432-1.331=0.101
policies=20
mean1740.005-1739.998=0.007
σ0.336-0.331=0.005
min1739.764-1739.758=0.006
max1740.498-1740.484=0.014
mean760.000
σ0.000
min760.000
max760.000
mean447.500-446.000=1.500
σ9.950-9.381=0.569
min437.000-436.000=1.000
max456.000-454.000=2.000
mean2.666-2.665=0.001
σ0.021-0.017=0.005
min2.637-2.645=-0.008
max2.685-2.682=0.003
policies=200
mean17409.292-17409.163=0.129
σ0.077-0.087=-0.011
min17409.208-17409.058=0.150
max17409.392-17409.238=0.155
mean7600.000
σ0.000
min7600.000
max7600.000
mean492.750-498.000=-5.250
σ4.272-3.830=0.442
min487.000-495.000=-8.000
max496.000-503.000=-7.000
mean26.824-26.879=-0.054
σ0.092-0.109=-0.017
min26.724-26.783=-0.059
max26.926-26.979=-0.053