The routers don't matter. They just split your internet connections.
Different internet providers (ISP), yes. They should give you different IPs.
Best you go on each and check with an IP-checking website to verify they're different IPs anyways.
It's easy. Just Google an IP checker, or a simple one for example:
(you need an account to see links)