Compare commits

Home / Compare 1068485c .. a00dd2c7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.396-70.396=0.001
σ0.047-0.045=0.002
min70.370-70.373=-0.003
max70.524-70.522=0.003
mean412.100-413.000=-0.900
σ0.316-0.000=0.316
min412.000-413.000=-1.000
max413.000
mean0.157-0.158=-0.001
σ0.005-0.004=0.001
min0.149-0.155=-0.005
max0.163-0.164=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.145-21.145=0.001
σ0.003-0.003=0.000
min21.140-21.141=-0.000
max21.150-21.148=0.002
mean413.000
σ0.000
min413.000
max413.000
mean0.064-0.063=0.001
σ0.004-0.005=-0.001
min0.058-0.058=0.000
max0.074-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.696-1752.698=-0.003
σ0.360-0.360=0.000
min1752.123-1752.126=-0.003
max1753.282-1753.284=-0.002
mean1636.150-1659.200=-23.050
σ613.738-639.276=-25.538
min624.000-617.000=7.000
max2469.000-2789.000=-320.000
mean2.717-2.836=-0.119
σ0.179-0.125=0.054
min2.302-2.534=-0.231
max2.968-3.096=-0.128

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.610-270.607=0.004
σ0.008-0.007=0.001
min270.602-270.597=0.004
max270.620-270.614=0.006
mean2469.000-2789.000=-320.000
σ0.000
min2469.000-2789.000=-320.000
max2469.000-2789.000=-320.000
mean0.381-0.381=0.000
σ0.006-0.003=0.003
min0.376-0.378=-0.002
max0.389-0.386=0.003
iters=5
new-facts=1
prior-facts=6402
mean1931.042-1931.043=-0.001
σ0.005-0.003=0.002
min1931.037-1931.040=-0.003
max1931.047-1931.046=0.001
mean2469.000-2789.000=-320.000
σ0.000
min2469.000-2789.000=-320.000
max2469.000-2789.000=-320.000
mean3.012-2.909=0.103
σ0.118-0.127=-0.010
min2.862-2.713=0.150
max3.182-3.045=0.136
iters=5
new-facts=6402
prior-facts=1
mean4751.807-4751.734=0.073
σ0.844-0.931=-0.087
min4751.208-4751.248=-0.040
max4753.289-4753.397=-0.108
mean2469.000-2789.000=-320.000
σ0.000
min2469.000-2789.000=-320.000
max2469.000-2789.000=-320.000
mean8.182-8.764=-0.582
σ0.696-0.353=0.343
min7.622-8.227=-0.605
max9.248-9.117=0.131
iters=5
new-facts=6402
prior-facts=6402
mean4942.228-4942.236=-0.008
σ0.028-0.020=0.009
min4942.194-4942.212=-0.018
max4942.255-4942.262=-0.007
mean2957.000-3063.400=-106.400
σ435.857-253.263=182.594
min2469.000-2789.000=-320.000
max3541.000-3417.000=124.000
mean8.430-8.584=-0.154
σ0.140-0.160=-0.020
min8.313-8.394=-0.082
max8.664-8.797=-0.133

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.849-1.118=0.731
σ0.055-0.259=-0.204
min1.805-0.940=0.864
max1.940-1.569=0.371

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.195-467.212=-0.017
σ575.929-575.933=-0.004
min179.228-179.237=-0.008
max1331.088-1331.112=-0.024
mean86.250
σ8.500
min82.000
max99.000
mean2469.000-2789.000=-320.000
σ0.000
min2469.000-2789.000=-320.000
max2469.000-2789.000=-320.000
mean0.565-0.443=0.123
σ0.583-0.306=0.277
min0.265-0.284=-0.020
max1.440-0.902=0.538
policies=20
mean1792.538-1792.622=-0.084
σ0.300-0.340=-0.039
min1792.348-1792.354=-0.006
max1792.986-1793.119=-0.133
mean820.000
σ0.000
min820.000
max820.000
mean2469.000-2789.000=-320.000
σ0.000
min2469.000-2789.000=-320.000
max2469.000-2789.000=-320.000
mean2.774-2.828=-0.054
σ0.025-0.083=-0.058
min2.746-2.779=-0.033
max2.798-2.952=-0.154
policies=200
mean17932.895-17932.990=-0.095
σ0.643-0.370=0.273
min17932.241-17932.767=-0.526
max17933.782-17933.544=0.238
mean8200.000
σ0.000
min8200.000
max8200.000
mean2469.000-2789.000=-320.000
σ0.000
min2469.000-2789.000=-320.000
max2469.000-2789.000=-320.000
mean28.040-28.080=-0.040
σ0.122-0.087=0.035
min27.966-28.017=-0.051
max28.222-28.205=0.017