I've found several variations. This article simply credits a Yorkshireman.
It was the Yorkshireman who said to his friend "Everyone in the world is quite mad, except for me and thee. And sometimes I have my doubts about thee."
I found that page too, McGruff. In that form I can't find the quote definitely attributed to anyone. I think the Yorkshire attribution comes from that being about the only place the formal "thee" is still used, now that even American Quakers had given up the practice by WWI. The substitution of 'mad for 'queer' is self-explanatory, I think.
Here are a few places crediting Robert Owen:
Return to FunTrivia
"Ask FunTrivia" strives to offer the best answers possible to trivia questions. We ask our submitters to thoroughly research questions and provide sources where possible. Feel free to post corrections or additions. This is server B184.