Not sure of your exact timeline but Ben was in America doing creature-related odd jobs from 1882 - 1884. At least some part of that was in the Arizona/New Mexico/Utah area because he got a tattoo of a thunderbird lol
He was then cursebreaking and traveling to various places between 1884-1887, and was exiled to Canada in autumn of 1887 for about 6 months. So. There are plenty of avenues for overlap >> he already has one kid being raised by another man, what's one more?

Alfred lost his virginity in America but that's in 1873 so the math's not mathing there lol. Anyway he could in theory have brushed shoulders with people in North or South America but not useful for actual family connections.

Also the Urquarts are American on their mom's side so could potentially be related to that guy but tbh I have forgotten if there were ever any details established on mom beyond "is American" and "is black" and "is dead" LOL so you'd have to dig around to see if that would actually work xD