Compare commits

Home / Compare d202e6be .. 692f5a9e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.393-70.389=0.004
σ0.045-0.048=-0.003
min70.369-70.358=0.011
max70.519-70.521=-0.003
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.161-0.159=0.002
σ0.003-0.003=0.001
min0.158-0.156=0.002
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.147-21.145=0.002
σ0.010-0.001=0.009
min21.139-21.143=-0.005
max21.174-21.147=0.027
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.063-0.063=0.000
σ0.003-0.004=-0.000
min0.059-0.058=0.001
max0.070-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.700-1752.700=-0.000
σ0.362-0.361=0.001
min1752.125-1752.123=0.001
max1753.299-1753.267=0.032
mean1652.550-1654.500=-1.950
σ630.467-627.640=2.827
min615.000-627.000=-12.000
max2763.000-2858.000=-95.000
mean2.778-2.863=-0.085
σ0.174-0.055=0.118
min2.280-2.761=-0.480
max3.083-2.966=0.117

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.608-270.518=0.090
σ0.006-0.006=0.001
min270.602-270.510=0.092
max270.617-270.524=0.093
mean2763.000-2858.000=-95.000
σ0.000
min2763.000-2858.000=-95.000
max2763.000-2858.000=-95.000
mean0.375-0.391=-0.016
σ0.003-0.014=-0.011
min0.372-0.377=-0.005
max0.378-0.411=-0.033
iters=5
new-facts=1
prior-facts=6402
mean1931.038-1930.940=0.097
σ0.006-0.011=-0.005
min1931.029-1930.922=0.107
max1931.046-1930.949=0.097
mean2763.000-2858.000=-95.000
σ0.000
min2763.000-2858.000=-95.000
max2763.000-2858.000=-95.000
mean3.025-2.977=0.048
σ0.087-0.059=0.028
min2.938-2.874=0.064
max3.143-3.022=0.121
iters=5
new-facts=6402
prior-facts=1
mean4751.765-4751.635=0.130
σ1.011-0.921=0.090
min4751.256-4751.147=0.109
max4753.570-4753.278=0.291
mean2763.000-2858.000=-95.000
σ0.000
min2763.000-2858.000=-95.000
max2763.000-2858.000=-95.000
mean8.826-8.921=-0.095
σ0.747-0.259=0.488
min7.853-8.676=-0.823
max9.845-9.358=0.487
iters=5
new-facts=6402
prior-facts=6402
mean4942.233-4942.001=0.231
σ0.015-0.186=-0.171
min4942.214-4941.794=0.420
max4942.251-4942.167=0.085
mean2995.000-3018.400=-23.400
σ221.718-184.263=37.455
min2763.000-2858.000=-95.000
max3316.000-3308.000=8.000
mean8.510-8.619=-0.109
σ0.099-0.271=-0.172
min8.411-8.367=0.044
max8.637-9.073=-0.437

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.109-1.018=0.090
σ0.197-0.143=0.054
min0.928-0.924=0.004
max1.369-1.255=0.114

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.203-466.828=0.375
σ575.939-575.925=0.014
min179.232-178.859=0.373
max1331.112-1330.716=0.396
mean86.250-84.000=2.250
σ8.500-8.000=0.500
min82.000-80.000=2.000
max99.000-96.000=3.000
mean2763.000-2858.000=-95.000
σ0.000
min2763.000-2858.000=-95.000
max2763.000-2858.000=-95.000
mean0.476-0.440=0.037
σ0.393-0.303=0.090
min0.280-0.282=-0.002
max1.066-0.894=0.171
policies=20
mean1792.611-1788.849=3.762
σ0.362-0.356=0.006
min1792.389-1788.604=3.785
max1793.153-1789.375=3.778
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2763.000-2858.000=-95.000
σ0.000
min2763.000-2858.000=-95.000
max2763.000-2858.000=-95.000
mean2.779-2.846=-0.067
σ0.023-0.011=0.012
min2.757-2.831=-0.074
max2.810-2.857=-0.047
policies=200
mean17933.060-17894.685=38.374
σ0.492-0.540=-0.048
min17932.796-17894.393=38.403
max17933.797-17895.493=38.303
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2763.000-2858.000=-95.000
σ0.000
min2763.000-2858.000=-95.000
max2763.000-2858.000=-95.000
mean28.008-28.257=-0.250
σ0.158-0.564=-0.406
min27.892-27.733=0.159
max28.238-28.841=-0.602