Compare commits

Home / Compare d02ce9dd .. cbcf0983

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.374=0.001
σ0.059-0.059=-0.000
min70.342-70.337=0.005
max70.541-70.540=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.161-0.158=0.003
σ0.003-0.004=-0.001
min0.157-0.150=0.007
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.145-21.143=0.002
σ0.003-0.002=0.001
min21.140-21.139=0.001
max21.150-21.146=0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.065-0.063=0.002
σ0.002-0.002=-0.000
min0.063-0.058=0.005
max0.070-0.067=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.200=0.000
σ0.359-0.362=-0.003
min1751.632-1751.634=-0.002
max1752.773-1752.797=-0.024
mean1684.950-1653.650=31.300
σ637.497-646.710=-9.213
min666.000-644.000=22.000
max2713.000-2855.000=-142.000
mean2.800-2.822=-0.022
σ0.147-0.161=-0.014
min2.477-2.467=0.010
max2.996-3.143=-0.147

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.928-269.932=-0.003
σ0.008-0.011=-0.003
min269.918-269.917=0.001
max269.940-269.944=-0.004
mean2713.000-2855.000=-142.000
σ0.000
min2713.000-2855.000=-142.000
max2713.000-2855.000=-142.000
mean0.372-0.372=0.001
σ0.006-0.004=0.003
min0.369-0.370=-0.002
max0.383-0.378=0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.391-1930.399=-0.007
σ0.020-0.018=0.002
min1930.365-1930.372=-0.008
max1930.410-1930.421=-0.011
mean2713.000-2855.000=-142.000
σ0.000
min2713.000-2855.000=-142.000
max2713.000-2855.000=-142.000
mean2.554-2.662=-0.108
σ0.162-0.200=-0.038
min2.437-2.372=0.065
max2.828-2.874=-0.046
iters=5
new-facts=6402
prior-facts=1
mean4750.726-4750.863=-0.136
σ0.889-0.828=0.061
min4750.069-4750.376=-0.307
max4752.276-4752.338=-0.062
mean2713.000-2855.000=-142.000
σ0.000
min2713.000-2855.000=-142.000
max2713.000-2855.000=-142.000
mean8.600-8.626=-0.025
σ0.318-0.478=-0.160
min8.339-7.844=0.495
max8.986-9.069=-0.083
iters=5
new-facts=6402
prior-facts=6402
mean4941.332-4941.334=-0.002
σ0.085-0.084=0.001
min4941.258-4941.268=-0.009
max4941.425-4941.430=-0.005
mean2994.000-3109.600=-115.600
σ240.505-311.580=-71.076
min2713.000-2855.000=-142.000
max3318.000-3582.000=-264.000
mean8.433-8.651=-0.218
σ0.103-0.179=-0.077
min8.317-8.476=-0.159
max8.594-8.934=-0.341

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.101-1.083=0.018
σ0.174-0.269=-0.094
min0.933-0.933=0.001
max1.315-1.556=-0.241

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.994-465.994=-0.000
σ575.921-575.921=-0.000
min178.024-178.024=0.000
max1329.875-1329.875=-0.000
mean81.750
σ7.500
min78.000
max93.000
mean2713.000-2855.000=-142.000
σ0.000
min2713.000-2855.000=-142.000
max2713.000-2855.000=-142.000
mean0.563-0.444=0.120
σ0.556-0.303=0.253
min0.275-0.282=-0.007
max1.398-0.898=0.499
policies=20
mean1780.439-1780.520=-0.081
σ0.360-0.359=0.000
min1780.199-1780.250=-0.052
max1780.972-1781.043=-0.070
mean780.000
σ0.000
min780.000
max780.000
mean2713.000-2855.000=-142.000
σ0.000
min2713.000-2855.000=-142.000
max2713.000-2855.000=-142.000
mean2.766-2.868=-0.102
σ0.018-0.023=-0.005
min2.746-2.844=-0.099
max2.783-2.890=-0.107
policies=200
mean17811.439-17811.568=-0.129
σ0.583-0.472=0.111
min17811.071-17811.204=-0.134
max17812.299-17812.261=0.038
mean7800.000
σ0.000
min7800.000
max7800.000
mean2713.000-2855.000=-142.000
σ0.000
min2713.000-2855.000=-142.000
max2713.000-2855.000=-142.000
mean27.824-28.358=-0.534
σ0.137-0.516=-0.379
min27.731-27.833=-0.102
max28.027-28.884=-0.857