Stephen Colbert has a theory: the show Downton Abbey would not be nearly as charming and awesome if the characters spoke with American accents, as opposed to British accents.

So on Wednesday’s Late Show, he decided to put that theory to the test by having the Downton actors, who are all British, speak with stereotypical American accents. Turns out Colbert was right! Check out the evidence below!