How far back in your family tree can you go?

I have a lot relatives on both sides of the family. My grandfather on my mom’s side was one of 10+ siblings in South Carolina. (I still have to figure out the exact number.).

My dad is one of 5 or 6 siblings. But as far as lineage I have been told that my great great grandfather was born in Brazil and then emigrated to Nigeria during his lifetime.

I have to ask my aunt whose more in tune with family news, what’s what.

*postdated because this is part of a series*