Compare commits

Home / Compare a817256b .. f0715e64

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.695-70.696=-0.001
σ0.046-0.047=-0.001
min70.668-70.667=0.000
max70.823-70.827=-0.004
mean413.000-420.000=-7.000
σ0.000
min413.000-420.000=-7.000
max413.000-420.000=-7.000
mean0.157-0.159=-0.003
σ0.005-0.005=-0.000
min0.149-0.151=-0.002
max0.163-0.169=-0.007
cache=y
dps=1
iters=10
policies=100
mean21.421-21.420=0.000
σ0.002-0.002=0.000
min21.417-21.418=-0.000
max21.424-21.424=0.000
mean413.000-420.000=-7.000
σ0.000
min413.000-420.000=-7.000
max413.000-420.000=-7.000
mean0.065-0.065=0.001
σ0.003-0.003=0.000
min0.064-0.060=0.003
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.460=-0.001
σ0.360-0.362=-0.002
min1753.885-1753.893=-0.008
max1755.033-1755.044=-0.010
mean1669.200-1643.550=25.650
σ649.687-629.272=20.416
min623.000-644.000=-21.000
max2868.000-2852.000=16.000
mean2.799-2.827=-0.028
σ0.175-0.213=-0.038
min2.285-2.280=0.006
max2.998-3.175=-0.176

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.502-273.502=-0.000
σ0.007-0.006=0.001
min273.494-273.496=-0.002
max273.513-273.509=0.003
mean2868.000-2852.000=16.000
σ0.000
min2868.000-2852.000=16.000
max2868.000-2852.000=16.000
mean0.384-0.378=0.007
σ0.006-0.005=0.001
min0.381-0.373=0.008
max0.395-0.384=0.010
iters=5
new-facts=1
prior-facts=6402
mean1933.915-1933.900=0.014
σ0.015-0.013=0.002
min1933.903-1933.882=0.021
max1933.939-1933.913=0.026
mean2868.000-2852.000=16.000
σ0.000
min2868.000-2852.000=16.000
max2868.000-2852.000=16.000
mean2.813-2.995=-0.182
σ0.238-0.172=0.066
min2.454-2.718=-0.264
max3.028-3.189=-0.161
iters=5
new-facts=6402
prior-facts=1
mean4754.641-4754.581=0.060
σ0.922-0.914=0.008
min4754.160-4753.924=0.236
max4756.287-4756.186=0.101
mean2868.000-2852.000=16.000
σ0.000
min2868.000-2852.000=16.000
max2868.000-2852.000=16.000
mean8.779-8.272=0.507
σ0.282-0.618=-0.336
min8.494-7.801=0.693
max9.123-9.186=-0.062
iters=5
new-facts=6402
prior-facts=6402
mean4944.979-4945.109=-0.131
σ0.322-0.015=0.307
min4944.404-4945.094=-0.690
max4945.143-4945.131=0.012
mean3055.800-3034.000=21.800
σ208.577-258.140=-49.564
min2868.000-2852.000=16.000
max3375.000-3443.000=-68.000
mean8.665-8.436=0.229
σ0.226-0.115=0.110
min8.427-8.338=0.090
max8.945-8.622=0.323

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.049-1.023=0.026
σ0.143-0.140=0.004
min0.924-0.932=-0.008
max1.274-1.250=0.024

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.079-473.065=0.014
σ575.908-575.910=-0.002
min185.118-185.106=0.011
max1336.941-1336.930=0.011
mean88.250
σ8.500
min84.000
max101.000
mean2868.000-2852.000=16.000
σ0.000
min2868.000-2852.000=16.000
max2868.000-2852.000=16.000
mean0.496-0.486=0.010
σ0.377-0.374=0.002
min0.306-0.293=0.014
max1.061-1.048=0.014
policies=20
mean1851.428-1851.306=0.122
σ0.372-0.384=-0.012
min1851.147-1851.008=0.139
max1851.968-1851.859=0.109
mean840.000
σ0.000
min840.000
max840.000
mean2868.000-2852.000=16.000
σ0.000
min2868.000-2852.000=16.000
max2868.000-2852.000=16.000
mean2.957-2.986=-0.029
σ0.014-0.016=-0.002
min2.945-2.970=-0.025
max2.978-3.008=-0.030
policies=200
mean18519.759-18519.387=0.372
σ0.642-0.588=0.053
min18519.257-18518.949=0.308
max18520.611-18520.255=0.357
mean8400.000
σ0.000
min8400.000
max8400.000
mean2868.000-2852.000=16.000
σ0.000
min2868.000-2852.000=16.000
max2868.000-2852.000=16.000
mean29.172-29.213=-0.041
σ0.452-0.448=0.005
min28.779-28.908=-0.129
max29.823-29.877=-0.054