Nope. There is never a negative to a lower output impedance. The greater the differential between the output impedance of one piece and the input impedance of the next piece the higher the noise rejection.

And, aside from the extremes, there is little chance that any deck or processor is going to have more output voltage than any amplifier is going to accept.

 

in some cases with old Eclipse decks with the 5volt 50 ohm outputs and most line drivers, some amplifiers can clip