I don't have a problem with it provided the lens it's viewed through is how pointless the mound visits tend to be, and how bringing yet another person into the situation as a translator really flies into the face of the MLB's desire to improve the pace of game. There are plenty of players that don't speak English that are capable of communicating strategy with their battery mates without the aid of a translator (hence the language of baseball comment), and if Remy's overall stance is that this further impedes the flow of play, then I agree with him. I think his inability to convey this was a result of 1) being caught off guard by hearing what he said after he said it as an "oh shit" moment and 2) frantically stumbling to clarify as DOB asks him to elaborate and failing to be eloquent.
Jerry, while not everyone's cup of tea, has never struck me, in his years of being in the booth, as the type who would openly discriminate against someone's race/ethnicity or ability to speak English. on T&R this morning on the ride in, they even discuss a segment where he and Tim McCarver discuss how a visit to the mound is essentially a way to waste time and disrupt the rhythm of the batter where strategy rarely comes into play. If he believes this is the case, bringing another person into the fray to waste time could be argued as laughable.