Compare commits

Home / Compare 43648ea6 .. b3de8519

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.391=-0.001
σ0.048-0.047=0.001
min70.359-70.364=-0.005
max70.523-70.522=0.001
mean413.000-420.000=-7.000
σ0.000
min413.000-420.000=-7.000
max413.000-420.000=-7.000
mean0.158-0.161=-0.003
σ0.003-0.003=0.000
min0.154-0.158=-0.004
max0.163-0.166=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.004-0.003=0.001
min21.137-21.142=-0.004
max21.150-21.149=0.001
mean413.000-420.000=-7.000
σ0.000
min413.000-420.000=-7.000
max413.000-420.000=-7.000
mean0.063-0.065=-0.001
σ0.003-0.003=0.000
min0.060-0.063=-0.004
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.396=-0.000
σ0.362-0.361=0.001
min1751.821-1751.823=-0.002
max1752.984-1752.979=0.005
mean1659.800-1654.750=5.050
σ633.236-634.445=-1.210
min618.000-625.000=-7.000
max2771.000-2832.000=-61.000
mean2.798-2.831=-0.034
σ0.183-0.157=0.025
min2.269-2.482=-0.213
max3.173-3.104=0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.235-270.241=-0.006
σ0.007-0.006=0.001
min270.226-270.234=-0.009
max270.245-270.248=-0.003
mean2771.000-2832.000=-61.000
σ0.000
min2771.000-2832.000=-61.000
max2771.000-2832.000=-61.000
mean0.376-0.379=-0.003
σ0.003-0.007=-0.004
min0.370-0.373=-0.002
max0.379-0.391=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1930.702-1930.702=-0.000
σ0.017-0.007=0.010
min1930.672-1930.695=-0.023
max1930.711-1930.709=0.002
mean2771.000-2832.000=-61.000
σ0.000
min2771.000-2832.000=-61.000
max2771.000-2832.000=-61.000
mean2.518-2.577=-0.059
σ0.082-0.122=-0.039
min2.395-2.465=-0.070
max2.602-2.713=-0.111
iters=5
new-facts=6402
prior-facts=1
mean4751.440-4751.368=0.072
σ0.880-0.937=-0.057
min4750.945-4750.863=0.082
max4753.008-4753.041=-0.033
mean2771.000-2832.000=-61.000
σ0.000
min2771.000-2832.000=-61.000
max2771.000-2832.000=-61.000
mean8.263-8.700=-0.436
σ0.459-0.364=0.095
min7.648-8.144=-0.496
max8.772-9.121=-0.349
iters=5
new-facts=6402
prior-facts=6402
mean4941.726-4941.800=-0.074
σ0.213-0.164=0.049
min4941.493-4941.511=-0.018
max4941.896-4941.906=-0.010
mean3032.600-3077.400=-44.800
σ317.952-261.408=56.543
min2771.000-2832.000=-61.000
max3512.000-3351.000=161.000
mean8.392-8.821=-0.430
σ0.094-0.357=-0.263
min8.315-8.392=-0.077
max8.556-9.336=-0.780

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.050-1.025=0.026
σ0.133-0.134=-0.001
min0.930-0.933=-0.003
max1.258-1.243=0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.377-466.376=0.002
σ575.927-575.927=0.000
min178.411-178.404=0.007
max1330.268-1330.266=0.002
mean84.250
σ8.500
min80.000
max97.000
mean2771.000-2832.000=-61.000
σ0.000
min2771.000-2832.000=-61.000
max2771.000-2832.000=-61.000
mean0.443-0.440=0.003
σ0.304-0.304=-0.001
min0.290-0.285=0.005
max0.899-0.897=0.002
policies=20
mean1784.367-1784.355=0.013
σ0.369-0.374=-0.005
min1784.128-1784.102=0.026
max1784.914-1784.907=0.007
mean800.000
σ0.000
min800.000
max800.000
mean2771.000-2832.000=-61.000
σ0.000
min2771.000-2832.000=-61.000
max2771.000-2832.000=-61.000
mean2.836-2.885=-0.049
σ0.080-0.074=0.006
min2.762-2.837=-0.075
max2.941-2.995=-0.054
policies=200
mean17849.748-17849.836=-0.088
σ0.582-0.543=0.038
min17849.439-17849.382=0.058
max17850.620-17850.625=-0.005
mean8000.000
σ0.000
min8000.000
max8000.000
mean2771.000-2832.000=-61.000
σ0.000
min2771.000-2832.000=-61.000
max2771.000-2832.000=-61.000
mean28.035-27.738=0.297
σ0.205-0.090=0.116
min27.860-27.670=0.190
max28.303-27.862=0.441