Compare commits

Home / Compare 280a9b2c .. c54810d7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.372-70.376=-0.003
σ0.057-0.058=-0.001
min70.337-70.335=0.002
max70.532-70.537=-0.005
mean415.000-412.900=2.100
σ0.000-0.316=-0.316
min415.000-412.000=3.000
max415.000-413.000=2.000
mean0.154-0.157=-0.003
σ0.005-0.005=0.000
min0.150-0.149=0.001
max0.163-0.163=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.002-0.003=-0.001
min21.138-21.140=-0.002
max21.146-21.149=-0.003
mean415.000-413.800=1.200
σ0.000-0.422=-0.422
min415.000-413.000=2.000
max415.000-414.000=1.000
mean0.059-0.064=-0.005
σ0.002-0.002=0.000
min0.057-0.063=-0.006
max0.065-0.069=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.202-1752.198=0.003
σ0.361-0.363=-0.003
min1751.627-1751.627=-0.001
max1752.786-1752.782=0.004
mean1664.500-1629.450=35.050
σ626.020-600.277=25.743
min660.000-645.000=15.000
max2516.000-2419.000=97.000
mean2.860-2.790=0.071
σ0.065-0.151=-0.086
min2.757-2.282=0.475
max3.016-3.003=0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.933-269.928=0.005
σ0.010-0.006=0.004
min269.919-269.921=-0.002
max269.945-269.937=0.007
mean2516.000-2419.000=97.000
σ0.000
min2516.000-2419.000=97.000
max2516.000-2419.000=97.000
mean0.380-0.373=0.007
σ0.006-0.006=-0.000
min0.376-0.370=0.007
max0.390-0.383=0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.399-1930.384=0.015
σ0.018-0.018=0.000
min1930.376-1930.363=0.013
max1930.420-1930.402=0.018
mean2516.000-2419.000=97.000
σ0.000
min2516.000-2419.000=97.000
max2516.000-2419.000=97.000
mean2.480-2.545=-0.065
σ0.124-0.156=-0.031
min2.318-2.447=-0.129
max2.661-2.818=-0.156
iters=5
new-facts=6402
prior-facts=1
mean4750.597-4750.847=-0.250
σ1.029-0.818=0.210
min4749.732-4750.309=-0.577
max4752.276-4752.293=-0.017
mean2516.000-2419.000=97.000
σ0.000
min2516.000-2419.000=97.000
max2516.000-2419.000=97.000
mean8.640-8.646=-0.005
σ0.228-0.188=0.040
min8.419-8.500=-0.081
max8.932-8.967=-0.035
iters=5
new-facts=6402
prior-facts=6402
mean4941.334-4941.262=0.071
σ0.083-0.123=-0.039
min4941.266-4941.079=0.187
max4941.432-4941.425=0.007
mean2984.600-2981.800=2.800
σ308.334-282.544=25.790
min2575.000-2592.000=-17.000
max3376.000-3318.000=58.000
mean8.572-8.492=0.080
σ0.135-0.049=0.086
min8.412-8.409=0.003
max8.744-8.532=0.212

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.789-1.672=0.117
σ0.214-0.172=0.042
min1.445-1.426=0.019
max2.015-1.873=0.141

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.901-465.903=-0.001
σ575.759-575.758=0.001
min178.021-178.021=0.000
max1329.540-1329.540=0.000
mean81.750
σ7.500
min78.000
max93.000
mean2516.000-2419.000=97.000
σ0.000
min2516.000-2419.000=97.000
max2516.000-2419.000=97.000
mean0.547-0.562=-0.015
σ0.525-0.564=-0.039
min0.279-0.278=0.001
max1.334-1.408=-0.074
policies=20
mean1780.444-1780.453=-0.009
σ0.346-0.358=-0.012
min1780.219-1780.204=0.016
max1780.957-1780.983=-0.026
mean780.000
σ0.000
min780.000
max780.000
mean2516.000-2419.000=97.000
σ0.000
min2516.000-2419.000=97.000
max2516.000-2419.000=97.000
mean2.774-2.769=0.005
σ0.019-0.017=0.001
min2.758-2.750=0.008
max2.794-2.789=0.005
policies=200
mean17811.200-17811.212=-0.012
σ0.457-0.413=0.044
min17810.782-17810.951=-0.168
max17811.848-17811.828=0.020
mean7800.000
σ0.000
min7800.000
max7800.000
mean2516.000-2419.000=97.000
σ0.000
min2516.000-2419.000=97.000
max2516.000-2419.000=97.000
mean27.792-27.939=-0.147
σ0.042-0.151=-0.109
min27.734-27.834=-0.101
max27.833-28.162=-0.329