We should stop thinking of time as a linear dimension and think of it in terms of rates of change instead. The universe will make a lot more sense.
Time, as a line we travel along, is simply a mathematical abstraction that helps us understand the world. All of the existence is contained within “now.” The future and the past are not “places” that physically exist. The future is a prediction, and the past is a memory. Nothing more.