So if we're saying that the universe is infinite, then there's your answer.
You can take any portion of the universe and that portion, whether it be a tract of space, a stellar system, a galaxy, whatever.
All of these entities are finite. Finite component, infinite whole.