我有一个按时间间隔运行的抓取。我想在抓取完成后发送一封电子邮件。这样做的最佳方法是什么?
我正在考虑编写一个扩展,但我不知道如何从扩展中访问正在写入输出的文件。
请您参考如下方法:
您是否考虑过 Hook spider_closed发出信号并使用 scrapy.mail.MailSender服务?
scrapy.signals.spider_closed(spider, reason)
[...]
reason (str) – a string which describes the reason why the spider was closed. If it was closed because the spider has completed scraping, the reason is 'finished'.
