This paper examines one source of spectral degradation in polar and multilevel outphasing transmitters. The degradation is caused by the amplitude signal appearing at the transmitter output as a baseband component, in addition to the desired RF signal. This baseband component contains sampling images and quantization noise across the spectrum. Thus, it adds noise at the signal band where it cannot be filtered and limits the achievable ACLR, particularly in wideband LTE and 5G systems. We analyze the origin of this phenomenon and related effects of system and signal parameters, and propose three design solutions for eliminating or alleviating the problem. Our analysis and simulations demonstrate that using a voltage-subtracting power combiner cancels the described degradation, potentially leading to significant improvement in spectral performance.