Compare commits

Home / Compare d4a1d8c3 .. e2a93264

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.393-70.393=0.001
σ0.046-0.046=-0.000
min70.371-70.371=-0.001
max70.522-70.522=0.000
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.160-0.160=-0.001
σ0.003-0.003=0.000
min0.156-0.157=-0.000
max0.165-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.147=-0.003
σ0.003-0.012=-0.008
min21.137-21.136=0.001
max21.148-21.179=-0.032
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.064-0.062=0.002
σ0.003-0.004=-0.001
min0.062-0.057=0.005
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.395=-0.000
σ0.362-0.361=0.001
min1751.828-1751.826=0.002
max1752.977-1752.974=0.003
mean1660.550-1658.600=1.950
σ637.810-630.920=6.890
min625.000-627.000=-2.000
max2814.000-2774.000=40.000
mean2.791-2.800=-0.009
σ0.136-0.152=-0.017
min2.495-2.403=0.092
max3.083-3.036=0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.238-270.238=-0.001
σ0.009-0.008=0.002
min270.224-270.228=-0.004
max270.246-270.247=-0.001
mean2814.000-2774.000=40.000
σ0.000
min2814.000-2774.000=40.000
max2814.000-2774.000=40.000
mean0.382-0.384=-0.002
σ0.008-0.009=-0.001
min0.374-0.373=0.001
max0.396-0.398=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.707-1930.699=0.008
σ0.006-0.016=-0.011
min1930.698-1930.671=0.027
max1930.714-1930.712=0.002
mean2814.000-2774.000=40.000
σ0.000
min2814.000-2774.000=40.000
max2814.000-2774.000=40.000
mean2.519-2.598=-0.079
σ0.077-0.132=-0.055
min2.446-2.478=-0.032
max2.613-2.756=-0.143
iters=5
new-facts=6402
prior-facts=1
mean4751.397-4751.098=0.299
σ0.845-0.804=0.041
min4750.919-4750.386=0.533
max4752.898-4752.408=0.490
mean2814.000-2774.000=40.000
σ0.000
min2814.000-2774.000=40.000
max2814.000-2774.000=40.000
mean8.436-8.366=0.070
σ0.450-0.644=-0.193
min7.862-7.754=0.108
max8.918-9.299=-0.381
iters=5
new-facts=6402
prior-facts=6402
mean4941.870-4941.804=0.066
σ0.019-0.139=-0.121
min4941.851-4941.557=0.294
max4941.894-4941.886=0.008
mean3029.000-3017.800=11.200
σ215.841-302.626=-86.784
min2814.000-2774.000=40.000
max3319.000-3470.000=-151.000
mean8.552-8.520=0.032
σ0.169-0.148=0.021
min8.361-8.373=-0.013
max8.805-8.722=0.083

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.019=0.001
σ0.138-0.130=0.008
min0.931-0.930=0.001
max1.247-1.225=0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.756-466.756=-0.000
σ575.926-575.929=-0.003
min178.786-178.789=-0.003
max1330.645-1330.650=-0.004
mean86.250
σ8.500
min82.000
max99.000
mean2814.000-2774.000=40.000
σ0.000
min2814.000-2774.000=40.000
max2814.000-2774.000=40.000
mean0.438-0.446=-0.008
σ0.302-0.302=0.000
min0.283-0.288=-0.004
max0.891-0.899=-0.008
policies=20
mean1788.138-1788.158=-0.021
σ0.360-0.375=-0.015
min1787.892-1787.907=-0.015
max1788.668-1788.712=-0.044
mean820.000
σ0.000
min820.000
max820.000
mean2814.000-2774.000=40.000
σ0.000
min2814.000-2774.000=40.000
max2814.000-2774.000=40.000
mean2.881-2.851=0.029
σ0.108-0.077=0.031
min2.766-2.788=-0.022
max3.026-2.953=0.073
policies=200
mean17888.131-17887.912=0.219
σ0.443-0.572=-0.128
min17887.875-17887.607=0.268
max17888.792-17888.769=0.023
mean8200.000
σ0.000
min8200.000
max8200.000
mean2814.000-2774.000=40.000
σ0.000
min2814.000-2774.000=40.000
max2814.000-2774.000=40.000
mean28.028-28.065=-0.037
σ0.096-0.186=-0.090
min27.958-27.914=0.044
max28.169-28.333=-0.164