Compare commits

Home / Compare 1ab4c8a7 .. dba2c70a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.951-35.951=0.000
σ0.102-0.102=-0.000
min35.907-35.907=0.000
max36.240-36.241=-0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.076-0.077=-0.001
σ0.005-0.005=0.001
min0.070-0.071=-0.002
max0.085-0.084=0.002
cache=y
dps=1
iters=10
policies=100
mean26.201-26.201=0.000
σ0.003-0.003=0.000
min26.195-26.197=-0.002
max26.205-26.206=-0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.060-0.060=-0.000
σ0.003-0.004=-0.001
min0.057-0.056=0.001
max0.067-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.302-1756.300=0.003
σ0.365-0.368=-0.003
min1755.729-1755.725=0.004
max1756.895-1756.892=0.003
mean1649.550-1656.400=-6.850
σ639.766-632.669=7.096
min618.000-610.000=8.000
max2750.000-2726.000=24.000
mean2.364-2.365=-0.001
σ0.135-0.086=0.049
min2.052-2.148=-0.096
max2.634-2.550=0.084

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.821-278.817=0.004
σ0.006-0.005=0.001
min278.815-278.808=0.007
max278.831-278.821=0.010
mean2750.000-2726.000=24.000
σ0.000
min2750.000-2726.000=24.000
max2750.000-2726.000=24.000
mean0.412-0.411=0.002
σ0.006-0.006=0.000
min0.409-0.407=0.002
max0.423-0.421=0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.874-2268.877=-0.003
σ0.012-0.016=-0.004
min2268.855-2268.849=0.006
max2268.886-2268.887=-0.001
mean2750.000-2726.000=24.000
σ0.000
min2750.000-2726.000=24.000
max2750.000-2726.000=24.000
mean2.954-2.970=-0.016
σ0.124-0.063=0.062
min2.840-2.904=-0.064
max3.147-3.043=0.104
iters=5
new-facts=6402
prior-facts=1
mean4954.011-4954.230=-0.219
σ0.938-0.799=0.139
min4953.406-4953.728=-0.322
max4955.653-4955.645=0.008
mean2750.000-2726.000=24.000
σ0.000
min2750.000-2726.000=24.000
max2750.000-2726.000=24.000
mean7.894-8.074=-0.180
σ0.134-0.254=-0.120
min7.722-7.822=-0.100
max8.046-8.372=-0.325
iters=5
new-facts=6402
prior-facts=6402
mean5168.651-5168.789=-0.139
σ0.194-0.080=0.115
min5168.389-5168.723=-0.334
max5168.878-5168.879=-0.001
mean3452.000-3471.200=-19.200
σ483.676-470.644=13.032
min2860.000-2845.000=15.000
max4148.000-4111.000=37.000
mean9.147-9.333=-0.186
σ0.403-0.276=0.127
min8.673-8.896=-0.223
max9.682-9.630=0.052

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-0.995=0.033
σ0.184-0.066=0.117
min0.939-0.939=0.000
max1.356-1.072=0.284

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.812-459.808=0.004
σ571.587-571.583=0.004
min174.011-174.009=0.001
max1317.193-1317.182=0.010
mean79.500
σ7.000
min76.000
max90.000
mean2750.000-2726.000=24.000
σ0.000
min2750.000-2726.000=24.000
max2750.000-2726.000=24.000
mean0.538-0.549=-0.011
σ0.538-0.554=-0.016
min0.267-0.269=-0.002
max1.346-1.381=-0.035
policies=20
mean1740.390-1740.326=0.063
σ0.319-0.320=-0.001
min1740.192-1740.122=0.070
max1740.865-1740.804=0.062
mean760.000
σ0.000
min760.000
max760.000
mean2750.000-2726.000=24.000
σ0.000
min2750.000-2726.000=24.000
max2750.000-2726.000=24.000
mean2.688-2.692=-0.004
σ0.009-0.015=-0.006
min2.676-2.679=-0.002
max2.697-2.707=-0.010
policies=200
mean17411.001-17410.072=0.929
σ0.529-0.540=-0.010
min17410.634-17409.739=0.895
max17411.787-17410.871=0.917
mean7600.000
σ0.000
min7600.000
max7600.000
mean2750.000-2726.000=24.000
σ0.000
min2750.000-2726.000=24.000
max2750.000-2726.000=24.000
mean27.102-27.085=0.017
σ0.119-0.085=0.034
min26.987-26.960=0.027
max27.265-27.145=0.120