Compare commits

Home / Compare 670de879 .. 3a8985f6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.967-35.965=0.002
σ0.102-0.102=-0.001
min35.924-35.914=0.011
max36.254-36.255=-0.000
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.078-0.074=0.004
σ0.004-0.004=0.000
min0.075-0.070=0.005
max0.085-0.083=0.002
cache=y
dps=1
iters=10
policies=100
mean26.209-26.208=0.001
σ0.003-0.003=-0.001
min26.206-26.204=0.002
max26.214-26.214=0.001
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.060-0.059=0.001
σ0.003-0.003=0.000
min0.057-0.057=0.001
max0.068-0.065=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.313-1756.314=-0.001
σ0.366-0.368=-0.001
min1755.740-1755.736=0.003
max1756.908-1756.909=-0.001
mean1658.600-1660.300=-1.700
σ637.262-627.195=10.067
min612.000-676.000=-64.000
max2692.000-2680.000=12.000
mean2.394-2.354=0.040
σ0.175-0.082=0.092
min2.276-2.222=0.054
max3.066-2.479=0.587

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.846-278.848=-0.002
σ0.005-0.007=-0.002
min278.837-278.839=-0.002
max278.850-278.854=-0.004
mean2692.000-2680.000=12.000
σ0.000
min2692.000-2680.000=12.000
max2692.000-2680.000=12.000
mean0.412-0.414=-0.002
σ0.007-0.005=0.003
min0.406-0.406=-0.001
max0.422-0.417=0.005
iters=5
new-facts=1
prior-facts=6402
mean2268.909-2268.905=0.004
σ0.005-0.015=-0.010
min2268.902-2268.883=0.018
max2268.915-2268.919=-0.004
mean2692.000-2680.000=12.000
σ0.000
min2692.000-2680.000=12.000
max2692.000-2680.000=12.000
mean3.007-3.222=-0.214
σ0.133-0.206=-0.072
min2.900-2.930=-0.031
max3.169-3.507=-0.337
iters=5
new-facts=6402
prior-facts=1
mean4954.038-4954.285=-0.247
σ1.005-0.858=0.147
min4953.241-4953.854=-0.614
max4955.744-4955.817=-0.073
mean2692.000-2680.000=12.000
σ0.000
min2692.000-2680.000=12.000
max2692.000-2680.000=12.000
mean8.047-7.988=0.059
σ0.176-0.410=-0.234
min7.862-7.662=0.199
max8.235-8.690=-0.455
iters=5
new-facts=6402
prior-facts=6402
mean5168.813-5168.816=-0.002
σ0.080-0.079=0.001
min5168.744-5168.749=-0.005
max5168.902-5168.905=-0.003
mean3479.600-3365.200=114.400
σ475.204-416.138=59.066
min2849.000-2954.000=-105.000
max4127.000-3786.000=341.000
mean9.215-9.405=-0.190
σ0.300-0.338=-0.038
min8.920-9.085=-0.165
max9.686-9.961=-0.275

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.172-1.212=-0.040
σ0.369-0.368=0.002
min0.934-0.963=-0.029
max1.823-1.863=-0.040

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.358-460.361=-0.003
σ572.650-572.664=-0.013
min174.024-174.027=-0.003
max1319.334-1319.357=-0.023
mean79.500
σ7.000
min76.000
max90.000
mean2692.000-2680.000=12.000
σ0.000
min2692.000-2680.000=12.000
max2692.000-2680.000=12.000
mean0.533-0.552=-0.020
σ0.537-0.554=-0.017
min0.263-0.274=-0.011
max1.338-1.383=-0.045
policies=20
mean1740.482-1740.494=-0.012
σ0.326-0.314=0.012
min1740.276-1740.284=-0.008
max1740.968-1740.961=0.008
mean760.000
σ0.000
min760.000
max760.000
mean2692.000-2680.000=12.000
σ0.000
min2692.000-2680.000=12.000
max2692.000-2680.000=12.000
mean2.697-2.671=0.026
σ0.014-0.027=-0.013
min2.682-2.633=0.049
max2.713-2.696=0.017
policies=200
mean17411.848-17411.841=0.007
σ0.438-0.548=-0.110
min17411.507-17411.521=-0.014
max17412.491-17412.657=-0.167
mean7600.000
σ0.000
min7600.000
max7600.000
mean2692.000-2680.000=12.000
σ0.000
min2692.000-2680.000=12.000
max2692.000-2680.000=12.000
mean26.987-27.013=-0.027
σ0.075-0.048=0.027
min26.900-26.962=-0.063
max27.056-27.076=-0.020