Compare commits

Home / Compare 2a3a9486 .. 4c6e2b89

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-73.046=-37.782
σ0.053-0.049=0.005
min35.237-73.022=-37.785
max35.415-73.184=-37.769
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.086-0.161=-0.075
σ0.004-0.003=0.002
min0.082-0.158=-0.076
max0.094-0.166=-0.072
cache=y
dps=1
iters=10
policies=100
mean23.770-23.740=0.030
σ0.002-0.003=-0.001
min23.766-23.734=0.032
max23.774-23.744=0.030
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.068-0.064=0.004
σ0.003-0.003=0.000
min0.065-0.059=0.006
max0.075-0.068=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1758.786=-2.302
σ0.364-0.363=0.001
min1755.914-1758.217=-2.303
max1757.071-1759.371=-2.300
mean1647.500-1659.800=-12.300
σ642.368-631.172=11.196
min669.000-622.000=47.000
max2728.000-2892.000=-164.000
mean2.406-2.737=-0.331
σ0.147-0.212=-0.064
min2.233-2.254=-0.021
max2.792-3.087=-0.295

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.695-324.008=0.687
σ0.050-0.052=-0.002
min324.609-323.915=0.694
max324.732-324.034=0.698
mean2728.000-2892.000=-164.000
σ0.000
min2728.000-2892.000=-164.000
max2728.000-2892.000=-164.000
mean0.427-0.426=0.001
σ0.006-0.001=0.005
min0.423-0.425=-0.002
max0.437-0.427=0.010
iters=5
new-facts=1
prior-facts=6402
mean1985.247-1984.579=0.668
σ0.019-0.012=0.008
min1985.221-1984.568=0.653
max1985.266-1984.594=0.672
mean2728.000-2892.000=-164.000
σ0.000
min2728.000-2892.000=-164.000
max2728.000-2892.000=-164.000
mean2.661-2.608=0.054
σ0.147-0.080=0.067
min2.560-2.539=0.022
max2.898-2.710=0.188
iters=5
new-facts=6402
prior-facts=1
mean4808.868-4808.118=0.750
σ7.636-7.520=0.116
min4805.365-4804.738=0.628
max4822.528-4821.570=0.958
mean2728.000-2892.000=-164.000
σ0.000
min2728.000-2892.000=-164.000
max2728.000-2892.000=-164.000
mean8.648-8.761=-0.114
σ0.206-0.164=0.043
min8.430-8.612=-0.182
max8.870-8.952=-0.082
iters=5
new-facts=6402
prior-facts=6402
mean4996.466-4995.805=0.661
σ0.015-0.016=-0.001
min4996.449-4995.788=0.662
max4996.482-4995.819=0.662
mean3030.800-3020.800=10.000
σ355.549-203.297=152.252
min2728.000-2892.000=-164.000
max3556.000-3357.000=199.000
mean8.633-8.604=0.029
σ0.209-0.168=0.041
min8.459-8.462=-0.003
max8.951-8.881=0.069

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.032-1.013=0.019
σ0.129-0.143=-0.015
min0.914-0.911=0.003
max1.229-1.247=-0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.966-468.349=-5.383
σ574.280-574.230=0.050
min175.818-181.225=-5.407
max1324.386-1329.695=-5.309
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2728.000-2892.000=-164.000
σ0.000
min2728.000-2892.000=-164.000
max2728.000-2892.000=-164.000
mean0.556-0.447=0.110
σ0.567-0.306=0.261
min0.271-0.290=-0.019
max1.407-0.906=0.501
policies=20
mean1758.534-1812.619=-54.085
σ0.336-0.401=-0.066
min1758.311-1812.341=-54.030
max1759.031-1813.210=-54.178
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2728.000-2892.000=-164.000
σ0.000
min2728.000-2892.000=-164.000
max2728.000-2892.000=-164.000
mean2.712-2.887=-0.175
σ0.016-0.017=-0.001
min2.692-2.862=-0.170
max2.731-2.898=-0.167
policies=200
mean17592.470-18132.175=-539.705
σ0.409-0.888=-0.479
min17592.198-18131.008=-538.810
max17593.075-18132.919=-539.844
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2728.000-2892.000=-164.000
σ0.000
min2728.000-2892.000=-164.000
max2728.000-2892.000=-164.000
mean27.539-28.831=-1.292
σ0.348-0.341=0.007
min27.262-28.487=-1.225
max28.023-29.135=-1.112