I am questioning the assumption of the passage of time in the absence of space or action.
the following MAY help......
Experiments continue to show that there is no 'space' that stands apart from space-time itself...no arena in which matter, energy and gravity operate which is not affected by matter, energy and gravity. General relativity tells us that what we call space is just another feature of the gravitational field of the universe, so space and space-time can and do not exist apart from the matter and energy that creates the gravitational field. This is not speculation, but sound observation.
https://einstein.stanford.edu/content/relativity/a11332.html