scrapy - Splash do not render the whole page

Question

I like to use scrapy and splash to grabb some data but poorly splash seems not to render the whole --> page <--.

The page should look like this:

But it looks like this:

So some of the more important information is missing. I already tried to increase the waiting time but this had no positive effect. Does anyone have an idea what I could do, to make this work?

Answer 1

Try to look at Splash FAQ where common problems with page rendering are discussed. Especially, I've often seen problem with private mode. Here is described how to turn it off. You can check if private mode is the issue in Splash web console, just edit the default LUA script and add

splash.private_mode_enabled = false