Compare commits

Home / Compare 2210753b .. 8ecefac8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.374=-0.000
σ0.058-0.059=-0.000
min70.335-70.334=0.001
max70.537-70.538=-0.000
mean411.000-418.000=-7.000
σ0.000
min411.000-418.000=-7.000
max411.000-418.000=-7.000
mean0.158-0.158=-0.000
σ0.004-0.004=0.000
min0.150-0.151=-0.001
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.001
σ0.002-0.003=-0.001
min21.142-21.140=0.002
max21.147-21.148=-0.001
mean411.000-418.000=-7.000
σ0.000
min411.000-418.000=-7.000
max411.000-418.000=-7.000
mean0.066-0.065=0.001
σ0.003-0.002=0.002
min0.063-0.063=-0.000
max0.072-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.202-1752.199=0.002
σ0.361-0.363=-0.001
min1751.628-1751.626=0.002
max1752.803-1752.791=0.013
mean1650.700-1653.300=-2.600
σ644.113-637.434=6.679
min615.000-647.000=-32.000
max2775.000-2852.000=-77.000
mean2.826-2.777=0.048
σ0.119-0.209=-0.090
min2.480-2.169=0.310
max3.050-3.121=-0.071

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.024-270.025=-0.001
σ0.007-0.005=0.002
min270.014-270.020=-0.006
max270.030-270.033=-0.003
mean2775.000-2852.000=-77.000
σ0.000
min2775.000-2852.000=-77.000
max2775.000-2852.000=-77.000
mean0.378-0.380=-0.002
σ0.010-0.003=0.007
min0.369-0.377=-0.008
max0.392-0.386=0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.477-1930.484=-0.007
σ0.020-0.020=0.001
min1930.451-1930.458=-0.007
max1930.496-1930.503=-0.007
mean2775.000-2852.000=-77.000
σ0.000
min2775.000-2852.000=-77.000
max2775.000-2852.000=-77.000
mean2.554-2.588=-0.034
σ0.132-0.239=-0.107
min2.453-2.380=0.073
max2.772-2.984=-0.212
iters=5
new-facts=6402
prior-facts=1
mean4750.821-4751.033=-0.212
σ0.946-0.760=0.186
min4749.808-4750.550=-0.742
max4752.373-4752.380=-0.007
mean2775.000-2852.000=-77.000
σ0.000
min2775.000-2852.000=-77.000
max2775.000-2852.000=-77.000
mean8.651-8.043=0.608
σ0.284-0.338=-0.054
min8.354-7.687=0.668
max9.054-8.491=0.563
iters=5
new-facts=6402
prior-facts=6402
mean4941.343-4941.416=-0.072
σ0.213-0.079=0.134
min4940.984-4941.349=-0.364
max4941.507-4941.508=-0.000
mean2993.800-3090.000=-96.200
σ212.957-310.919=-97.962
min2775.000-2852.000=-77.000
max3306.000-3566.000=-260.000
mean8.582-8.410=0.172
σ0.171-0.076=0.095
min8.338-8.353=-0.015
max8.789-8.537=0.252

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.032-1.082=-0.050
σ0.135-0.113=0.022
min0.941-0.933=0.008
max1.251-1.251=-0.000

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.913-465.919=-0.006
σ575.762-575.770=-0.008
min178.025-178.024=0.001
max1329.557-1329.574=-0.017
mean81.750
σ7.500
min78.000
max93.000
mean2775.000-2852.000=-77.000
σ0.000
min2775.000-2852.000=-77.000
max2775.000-2852.000=-77.000
mean0.445-0.442=0.003
σ0.307-0.307=-0.000
min0.292-0.284=0.007
max0.906-0.903=0.003
policies=20
mean1780.491-1780.510=-0.019
σ0.341-0.357=-0.016
min1780.242-1780.256=-0.014
max1780.988-1781.035=-0.046
mean780.000
σ0.000
min780.000
max780.000
mean2775.000-2852.000=-77.000
σ0.000
min2775.000-2852.000=-77.000
max2775.000-2852.000=-77.000
mean2.854-2.848=0.006
σ0.075-0.018=0.057
min2.760-2.831=-0.071
max2.943-2.872=0.071
policies=200
mean17811.464-17811.440=0.024
σ0.569-0.539=0.029
min17811.010-17811.095=-0.085
max17812.288-17812.243=0.046
mean7800.000
σ0.000
min7800.000
max7800.000
mean2775.000-2852.000=-77.000
σ0.000
min2775.000-2852.000=-77.000
max2775.000-2852.000=-77.000
mean27.912-28.263=-0.351
σ0.270-0.474=-0.204
min27.767-27.810=-0.043
max28.316-28.762=-0.446