Compare commits

Home / Compare 1d8e2a2c .. 64b9767f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.389=0.000
σ0.044-0.047=-0.003
min70.363-70.362=0.001
max70.511-70.520=-0.009
mean414.000
σ0.000
min414.000
max414.000
mean0.159-0.157=0.003
σ0.005-0.005=-0.000
min0.151-0.150=0.001
max0.169-0.165=0.004
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.002-0.003=-0.001
min21.141-21.140=0.001
max21.148-21.149=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.062=0.003
σ0.002-0.004=-0.002
min0.064-0.059=0.005
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.393=0.002
σ0.360-0.362=-0.003
min1751.827-1751.825=0.002
max1752.971-1752.981=-0.010
mean1661.150-1658.000=3.150
σ638.749-632.984=5.765
min621.000-617.000=4.000
max2815.000-2770.000=45.000
mean2.870-2.799=0.072
σ0.118-0.140=-0.023
min2.512-2.363=0.149
max3.053-3.028=0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.237-270.235=0.003
σ0.008-0.005=0.003
min270.227-270.229=-0.002
max270.249-270.242=0.007
mean2815.000-2770.000=45.000
σ0.000
min2815.000-2770.000=45.000
max2815.000-2770.000=45.000
mean0.379-0.379=0.001
σ0.007-0.007=-0.001
min0.372-0.372=-0.001
max0.386-0.392=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.689-1930.692=-0.003
σ0.021-0.012=0.009
min1930.662-1930.673=-0.011
max1930.707-1930.706=0.000
mean2815.000-2770.000=45.000
σ0.000
min2815.000-2770.000=45.000
max2815.000-2770.000=45.000
mean2.512-2.536=-0.024
σ0.198-0.120=0.077
min2.303-2.402=-0.099
max2.839-2.697=0.141
iters=5
new-facts=6402
prior-facts=1
mean4751.340-4751.327=0.013
σ0.923-0.982=-0.059
min4750.515-4750.599=-0.084
max4752.900-4753.046=-0.146
mean2815.000-2770.000=45.000
σ0.000
min2815.000-2770.000=45.000
max2815.000-2770.000=45.000
mean8.321-8.382=-0.061
σ0.669-0.569=0.100
min7.680-7.636=0.044
max9.400-9.090=0.310
iters=5
new-facts=6402
prior-facts=6402
mean4941.801-4941.859=-0.059
σ0.146-0.015=0.131
min4941.540-4941.842=-0.302
max4941.875-4941.881=-0.007
mean3005.800-2990.000=15.800
σ206.124-288.143=-82.019
min2815.000-2770.000=45.000
max3313.000-3443.000=-130.000
mean8.634-8.514=0.121
σ0.147-0.212=-0.064
min8.510-8.359=0.150
max8.870-8.877=-0.007

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.057-1.031=0.026
σ0.130-0.137=-0.007
min0.940-0.940=-0.001
max1.257-1.255=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.373-466.376=-0.003
σ575.936-575.927=0.009
min178.401-178.408=-0.006
max1330.277-1330.267=0.010
mean84.250
σ8.500
min80.000
max97.000
mean2815.000-2770.000=45.000
σ0.000
min2815.000-2770.000=45.000
max2815.000-2770.000=45.000
mean0.445-0.442=0.003
σ0.305-0.305=-0.000
min0.285-0.286=-0.001
max0.902-0.899=0.003
policies=20
mean1784.370-1784.343=0.027
σ0.341-0.360=-0.020
min1784.128-1784.099=0.030
max1784.866-1784.875=-0.008
mean800.000
σ0.000
min800.000
max800.000
mean2815.000-2770.000=45.000
σ0.000
min2815.000-2770.000=45.000
max2815.000-2770.000=45.000
mean2.886-2.844=0.043
σ0.113-0.103=0.009
min2.777-2.750=0.027
max3.044-2.984=0.060
policies=200
mean17849.718-17849.760=-0.042
σ0.522-0.422=0.100
min17849.374-17849.381=-0.007
max17850.490-17850.363=0.126
mean8000.000
σ0.000
min8000.000
max8000.000
mean2815.000-2770.000=45.000
σ0.000
min2815.000-2770.000=45.000
max2815.000-2770.000=45.000
mean27.962-27.977=-0.015
σ0.018-0.166=-0.149
min27.947-27.846=0.101
max27.985-28.218=-0.233