Compare commits

Home / Compare 7b6092ac .. 56e3cf6a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.380=-0.001
σ0.049-0.045=0.004
min70.349-70.351=-0.001
max70.515-70.504=0.011
mean413.000
σ0.000
min413.000
max413.000
mean0.160-0.160=0.000
σ0.003-0.002=0.001
min0.156-0.157=-0.001
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.003-0.002=0.001
min21.141-21.141=-0.000
max21.149-21.146=0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.001
min0.062-0.060=0.003
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.388=-0.001
σ0.363-0.362=0.001
min1751.820-1751.819=0.001
max1752.973-1752.976=-0.003
mean1648.500-1633.750=14.750
σ632.189-609.765=22.424
min626.000-631.000=-5.000
max2773.000-2455.000=318.000
mean2.818-2.879=-0.061
σ0.199-0.110=0.089
min2.311-2.684=-0.372
max3.172-3.088=0.084

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.125-270.132=-0.007
σ0.007-0.009=-0.001
min270.117-270.119=-0.003
max270.133-270.141=-0.008
mean2773.000-2455.000=318.000
σ0.000
min2773.000-2455.000=318.000
max2773.000-2455.000=318.000
mean0.375-0.389=-0.014
σ0.004-0.011=-0.006
min0.371-0.373=-0.002
max0.382-0.397=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1930.588-1930.590=-0.002
σ0.019-0.019=-0.000
min1930.567-1930.556=0.011
max1930.609-1930.600=0.009
mean2773.000-2455.000=318.000
σ0.000
min2773.000-2455.000=318.000
max2773.000-2455.000=318.000
mean2.571-2.571=-0.000
σ0.158-0.106=0.052
min2.444-2.472=-0.029
max2.795-2.725=0.070
iters=5
new-facts=6402
prior-facts=1
mean4751.134-4751.108=0.025
σ0.802-0.924=-0.122
min4750.661-4750.603=0.058
max4752.558-4752.757=-0.199
mean2773.000-2455.000=318.000
σ0.000
min2773.000-2455.000=318.000
max2773.000-2455.000=318.000
mean8.141-8.394=-0.253
σ0.402-0.795=-0.393
min7.763-7.668=0.095
max8.667-9.427=-0.760
iters=5
new-facts=6402
prior-facts=6402
mean4941.533-4941.523=0.010
σ0.082-0.083=-0.000
min4941.455-4941.455=-0.000
max4941.634-4941.614=0.020
mean3028.200-2958.000=70.200
σ299.916-447.635=-147.719
min2773.000-2455.000=318.000
max3470.000-3556.000=-86.000
mean8.629-8.489=0.140
σ0.374-0.088=0.286
min8.264-8.407=-0.143
max9.181-8.620=0.561

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.083-1.778=-0.695
σ0.115-0.107=0.008
min0.934-1.609=-0.675
max1.257-1.902=-0.644

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.356-466.354=0.001
σ575.923-575.915=0.008
min178.388-178.393=-0.005
max1330.240-1330.226=0.013
mean84.000
σ8.000
min80.000
max96.000
mean2773.000-2455.000=318.000
σ0.000
min2773.000-2455.000=318.000
max2773.000-2455.000=318.000
mean0.421-0.563=-0.141
σ0.263-0.565=-0.302
min0.285-0.277=0.008
max0.815-1.410=-0.595
policies=20
mean1784.241-1784.227=0.013
σ0.319-0.351=-0.033
min1784.012-1783.999=0.014
max1784.702-1784.749=-0.047
mean800.000
σ0.000
min800.000
max800.000
mean2773.000-2455.000=318.000
σ0.000
min2773.000-2455.000=318.000
max2773.000-2455.000=318.000
mean2.819-2.780=0.040
σ0.087-0.023=0.064
min2.773-2.757=0.017
max2.949-2.809=0.141
policies=200
mean17848.823-17848.890=-0.067
σ0.429-0.486=-0.057
min17848.513-17848.630=-0.117
max17849.459-17849.619=-0.160
mean8000.000
σ0.000
min8000.000
max8000.000
mean2773.000-2455.000=318.000
σ0.000
min2773.000-2455.000=318.000
max2773.000-2455.000=318.000
mean28.073-28.018=0.055
σ0.130-0.077=0.053
min27.990-27.928=0.062
max28.266-28.108=0.158