How to stop Preview becoming insane with VO by disabling continuous scrolling

So I have got quite an accessible pdf, it's from a book in the ebscohost library.
I am able to read most pages fine, but for whatever reason there are some pages where pressing vo-right after the first element VoiceOver goes crazy and autoscroll somehow to the last page in 5 seconds and I have to jump to the top level, go back manually to the right page and only use vo up and down arrow to read line by line otherwise it just starts skipping everything. It's a 39 pages pdf and any page after the 13th (arbitrarily) is very difficult to read because of this. I don't use say all (vo-a). I am on 15.4.
While writing, I discovered that pressing command 2 disables auto scroll and selects single page view, which seems to have solved the problem for me.