> There were millions of years without ice caps even

In case anyone was curious, this is a significant understatement. It is currently believed that the Earth had no ice caps for its first 2 billion years, before the Huronian glaciation, and then again no ice caps for another ~1.5 billion years.