Some of this might be true if you added boost to an engine not designed for it. When the entire drivetrain is engineered for boost it's a safe bet the engineers take in account boost/vacuum.
Engineers aren't perfect, material aren't perfect- nothing is. Therefore, the more complex it is, the more likely it is to fail. The more abuse the components have to endure, the more they will fail. A turbo engine by nature is very complex compared to a N/A engine. There is more crap to fail, and more crap will fail. Direct injection now? Even more.
The components in the TT3.5L engine have to endure higher pressures and stresses than the 6.2L engine. Yes, you can design around it- but it's nicer to not have to deal with high cylinder pressures when you want an engine to last a long time. 16 lbs of boost from the factory is a lot.