Answer: How can I use scrapy middleware in the scrapy Shell?

answer re: How can I use scrapy middleware in the scrapy Shell?

Jul 11 '22

1

Although, Middlewares set up in setting.py are enabled by default in scrapy shell. You can see it on the logs when running scrapy shell.

So to answer your question, yes you can do so using this command.

scrapy shell -s DOWNLOADER_MIDDLEWARES='<<your custom middleware>>'

You can override settings using the -s…

Open Full Answer