Compare commits

Home / Compare dd6adf4b .. 6292322e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.563=0.002
σ0.046-0.046=0.000
min70.536-70.540=-0.004
max70.693-70.691=0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.157-0.158=-0.001
σ0.006-0.004=0.001
min0.149-0.150=-0.001
max0.167-0.163=0.004
cache=y
dps=1
iters=10
policies=100
mean21.287-21.288=-0.000
σ0.004-0.003=0.001
min21.283-21.283=-0.000
max21.293-21.291=0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.064-0.063=0.001
σ0.002-0.003=-0.001
min0.062-0.058=0.004
max0.069-0.065=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.570-1753.376=0.194
σ0.360-0.361=-0.001
min1753.007-1752.806=0.202
max1754.157-1753.954=0.203
mean1652.750-1650.850=1.900
σ643.098-644.170=-1.073
min622.000-633.000=-11.000
max2884.000-2887.000=-3.000
mean2.848-2.776=0.072
σ0.120-0.210=-0.090
min2.477-2.256=0.221
max3.013-2.995=0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.013-271.755=0.259
σ0.007-0.006=0.001
min272.004-271.745=0.259
max272.020-271.760=0.260
mean2884.000-2887.000=-3.000
σ0.000
min2884.000-2887.000=-3.000
max2884.000-2887.000=-3.000
mean0.385-0.385=-0.000
σ0.010-0.006=0.005
min0.378-0.382=-0.003
max0.403-0.395=0.008
iters=5
new-facts=1
prior-facts=6402
mean1932.439-1932.180=0.259
σ0.010-0.012=-0.001
min1932.428-1932.161=0.267
max1932.450-1932.190=0.261
mean2884.000-2887.000=-3.000
σ0.000
min2884.000-2887.000=-3.000
max2884.000-2887.000=-3.000
mean2.895-3.024=-0.130
σ0.159-0.126=0.033
min2.667-2.884=-0.217
max3.021-3.190=-0.169
iters=5
new-facts=6402
prior-facts=1
mean4753.231-4752.817=0.414
σ0.809-0.921=-0.113
min4752.796-4752.125=0.671
max4754.675-4754.438=0.237
mean2884.000-2887.000=-3.000
σ0.000
min2884.000-2887.000=-3.000
max2884.000-2887.000=-3.000
mean7.996-8.456=-0.460
σ0.391-0.412=-0.021
min7.642-7.764=-0.122
max8.587-8.857=-0.270
iters=5
new-facts=6402
prior-facts=6402
mean4943.627-4943.375=0.252
σ0.019-0.011=0.009
min4943.608-4943.361=0.247
max4943.649-4943.387=0.262
mean3081.000-3085.600=-4.600
σ281.237-213.458=67.779
min2884.000-2887.000=-3.000
max3530.000-3402.000=128.000
mean8.465-8.516=-0.051
σ0.096-0.098=-0.002
min8.383-8.404=-0.021
max8.624-8.647=-0.023

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.071-1.030=0.041
σ0.224-0.138=0.086
min0.940-0.940=-0.000
max1.457-1.256=0.201

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.113-472.855=0.258
σ575.925-575.916=0.010
min185.138-184.888=0.250
max1337.001-1336.728=0.273
mean88.250
σ8.500
min84.000
max101.000
mean2884.000-2887.000=-3.000
σ0.000
min2884.000-2887.000=-3.000
max2884.000-2887.000=-3.000
mean0.451-0.449=0.001
σ0.302-0.303=-0.001
min0.296-0.290=0.006
max0.903-0.903=0.000
policies=20
mean1851.711-1849.203=2.508
σ0.371-0.369=0.001
min1851.413-1848.930=2.483
max1852.241-1849.741=2.500
mean840.000
σ0.000
min840.000
max840.000
mean2884.000-2887.000=-3.000
σ0.000
min2884.000-2887.000=-3.000
max2884.000-2887.000=-3.000
mean2.975-2.943=0.032
σ0.034-0.007=0.027
min2.948-2.933=0.016
max3.024-2.950=0.074
policies=200
mean18523.499-18498.742=24.757
σ0.527-0.509=0.018
min18523.153-18498.432=24.721
max18524.275-18499.503=24.771
mean8400.000
σ0.000
min8400.000
max8400.000
mean2884.000-2887.000=-3.000
σ0.000
min2884.000-2887.000=-3.000
max2884.000-2887.000=-3.000
mean29.209-29.268=-0.059
σ0.502-0.441=0.061
min28.756-28.856=-0.100
max29.761-29.769=-0.007