Compare commits

Home / Compare c0fa1467 .. 2cfc278a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.696-70.696=-0.000
σ0.046-0.047=-0.001
min70.672-70.667=0.004
max70.824-70.827=-0.003
mean411.000-420.000=-9.000
σ0.000
min411.000-420.000=-9.000
max411.000-420.000=-9.000
mean0.160-0.159=0.000
σ0.003-0.005=-0.002
min0.157-0.151=0.006
max0.165-0.169=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.424-21.420=0.003
σ0.012-0.002=0.010
min21.413-21.418=-0.005
max21.458-21.424=0.034
mean412.000-420.000=-8.000
σ0.000
min412.000-420.000=-8.000
max412.000-420.000=-8.000
mean0.063-0.065=-0.002
σ0.004-0.003=0.001
min0.058-0.060=-0.002
max0.071-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.460=-0.002
σ0.358-0.362=-0.004
min1753.890-1753.893=-0.002
max1755.027-1755.044=-0.016
mean1671.800-1643.550=28.250
σ652.553-629.272=23.281
min623.000-644.000=-21.000
max2862.000-2852.000=10.000
mean2.804-2.827=-0.023
σ0.162-0.213=-0.051
min2.324-2.280=0.044
max2.967-3.175=-0.208

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.507-273.502=0.004
σ0.005-0.006=-0.001
min273.502-273.496=0.007
max273.514-273.509=0.005
mean2862.000-2852.000=10.000
σ0.000
min2862.000-2852.000=10.000
max2862.000-2852.000=10.000
mean0.377-0.378=-0.001
σ0.005-0.005=0.001
min0.372-0.373=-0.000
max0.386-0.384=0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.897-1933.900=-0.003
σ0.015-0.013=0.002
min1933.888-1933.882=0.006
max1933.924-1933.913=0.011
mean2862.000-2852.000=10.000
σ0.000
min2862.000-2852.000=10.000
max2862.000-2852.000=10.000
mean2.856-2.995=-0.140
σ0.291-0.172=0.119
min2.428-2.718=-0.289
max3.168-3.189=-0.021
iters=5
new-facts=6402
prior-facts=1
mean4754.732-4754.581=0.151
σ0.819-0.914=-0.095
min4754.259-4753.924=0.335
max4756.193-4756.186=0.006
mean2862.000-2852.000=10.000
σ0.000
min2862.000-2852.000=10.000
max2862.000-2852.000=10.000
mean7.917-8.272=-0.355
σ0.467-0.618=-0.151
min7.484-7.801=-0.317
max8.711-9.186=-0.474
iters=5
new-facts=6402
prior-facts=6402
mean4945.111-4945.109=0.002
σ0.010-0.015=-0.005
min4945.097-4945.094=0.004
max4945.123-4945.131=-0.008
mean3064.200-3034.000=30.200
σ286.046-258.140=27.905
min2862.000-2852.000=10.000
max3518.000-3443.000=75.000
mean8.423-8.436=-0.013
σ0.128-0.115=0.013
min8.314-8.338=-0.024
max8.566-8.622=-0.055

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.046-1.023=0.023
σ0.129-0.140=-0.010
min0.932-0.932=-0.000
max1.247-1.250=-0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.077-473.065=0.012
σ575.911-575.910=0.001
min185.115-185.106=0.009
max1336.943-1336.930=0.014
mean88.250
σ8.500
min84.000
max101.000
mean2862.000-2852.000=10.000
σ0.000
min2862.000-2852.000=10.000
max2862.000-2852.000=10.000
mean0.450-0.486=-0.036
σ0.301-0.374=-0.073
min0.298-0.293=0.005
max0.902-1.048=-0.146
policies=20
mean1851.463-1851.306=0.157
σ0.387-0.384=0.003
min1851.187-1851.008=0.178
max1852.028-1851.859=0.170
mean840.000
σ0.000
min840.000
max840.000
mean2862.000-2852.000=10.000
σ0.000
min2862.000-2852.000=10.000
max2862.000-2852.000=10.000
mean2.942-2.986=-0.044
σ0.012-0.016=-0.004
min2.925-2.970=-0.045
max2.952-3.008=-0.056
policies=200
mean18519.886-18519.387=0.499
σ0.742-0.588=0.154
min18519.246-18518.949=0.297
max18520.772-18520.255=0.517
mean8400.000
σ0.000
min8400.000
max8400.000
mean2862.000-2852.000=10.000
σ0.000
min2862.000-2852.000=10.000
max2862.000-2852.000=10.000
mean29.019-29.213=-0.193
σ0.537-0.448=0.089
min28.715-28.908=-0.194
max29.822-29.877=-0.055