Compare commits

Home / Compare c749ede6 .. e468a95b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.393-70.396=-0.003
σ0.045-0.045=-0.001
min70.373-70.370=0.003
max70.519-70.521=-0.002
mean414.000-421.000=-7.000
σ0.000
min414.000-421.000=-7.000
max414.000-421.000=-7.000
mean0.161-0.158=0.003
σ0.003-0.005=-0.002
min0.158-0.148=0.010
max0.166-0.166=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.148-21.143=0.005
σ0.010-0.003=0.007
min21.141-21.139=0.002
max21.176-21.147=0.029
mean414.000-421.000=-7.000
σ0.000
min414.000-421.000=-7.000
max414.000-421.000=-7.000
mean0.067-0.061=0.006
σ0.002-0.003=-0.001
min0.065-0.058=0.007
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.396-1752.394=0.001
σ0.362-0.361=0.002
min1751.824-1751.826=-0.002
max1752.974-1752.970=0.004
mean1655.450-1633.800=21.650
σ644.182-588.730=55.452
min618.000-632.000=-14.000
max2775.000-2420.000=355.000
mean2.813-2.810=0.003
σ0.141-0.154=-0.013
min2.404-2.338=0.066
max3.121-2.982=0.139

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.239-270.238=0.001
σ0.006-0.010=-0.004
min270.233-270.226=0.007
max270.246-270.250=-0.004
mean2775.000-2420.000=355.000
σ0.000
min2775.000-2420.000=355.000
max2775.000-2420.000=355.000
mean0.378-0.383=-0.005
σ0.006-0.012=-0.006
min0.370-0.371=-0.001
max0.386-0.399=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1930.704-1930.701=0.003
σ0.008-0.015=-0.008
min1930.694-1930.677=0.017
max1930.715-1930.712=0.003
mean2775.000-2420.000=355.000
σ0.000
min2775.000-2420.000=355.000
max2775.000-2420.000=355.000
mean2.529-2.597=-0.068
σ0.093-0.254=-0.161
min2.446-2.435=0.010
max2.645-3.041=-0.396
iters=5
new-facts=6402
prior-facts=1
mean4751.285-4751.381=-0.096
σ0.905-0.848=0.057
min4750.494-4750.895=-0.401
max4752.847-4752.893=-0.046
mean2775.000-2420.000=355.000
σ0.000
min2775.000-2420.000=355.000
max2775.000-2420.000=355.000
mean8.501-8.608=-0.107
σ0.198-0.271=-0.072
min8.191-8.398=-0.207
max8.744-9.076=-0.332
iters=5
new-facts=6402
prior-facts=6402
mean4941.792-4941.865=-0.073
σ0.156-0.018=0.138
min4941.518-4941.840=-0.323
max4941.888-4941.880=0.007
mean3059.800-2987.400=72.400
σ261.851-264.430=-2.579
min2775.000-2633.000=142.000
max3424.000-3310.000=114.000
mean8.653-8.463=0.191
σ0.277-0.075=0.203
min8.348-8.382=-0.033
max8.982-8.558=0.424

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.016-1.828=-0.812
σ0.141-0.165=-0.025
min0.917-1.581=-0.664
max1.241-2.020=-0.778

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.753-466.748=0.005
σ575.932-575.924=0.008
min178.782-178.782=-0.001
max1330.651-1330.634=0.017
mean86.250
σ8.500
min82.000
max99.000
mean2775.000-2420.000=355.000
σ0.000
min2775.000-2420.000=355.000
max2775.000-2420.000=355.000
mean0.442-0.560=-0.119
σ0.303-0.558=-0.254
min0.284-0.278=0.006
max0.897-1.397=-0.500
policies=20
mean1788.151-1788.090=0.060
σ0.352-0.364=-0.011
min1787.904-1787.878=0.027
max1788.670-1788.635=0.035
mean820.000
σ0.000
min820.000
max820.000
mean2775.000-2420.000=355.000
σ0.000
min2775.000-2420.000=355.000
max2775.000-2420.000=355.000
mean2.855-2.782=0.073
σ0.053-0.017=0.036
min2.789-2.764=0.025
max2.918-2.797=0.122
policies=200
mean17888.011-17888.057=-0.046
σ0.516-0.573=-0.056
min17887.642-17887.680=-0.038
max17888.766-17888.895=-0.129
mean8200.000
σ0.000
min8200.000
max8200.000
mean2775.000-2420.000=355.000
σ0.000
min2775.000-2420.000=355.000
max2775.000-2420.000=355.000
mean28.039-28.013=0.025
σ0.100-0.073=0.028
min27.963-27.949=0.013
max28.185-28.101=0.084