python之获取 twitter 流 api 时如何在 Tornado 中重启 ioloop

我正在使用 TweetStream (https://github.com/joshmarshall/TweetStream)，这是一个基于 Tornado 的 Twitter 流模块来监控流 API。

我想知道如果要更改跟踪的词，如何重新启动获取过程。

我当前的解决方案(不完全是解决方案)给我一些错误。

stream = tweetstream.TweetStream(configuration,ioloop=main_io_loop) 
 
stream.fetch("/1.1/statuses/filter.json?track="+tornado.escape.url_escape(words), callback=callback) 
 
 
def check_words(): 
    global words 
    with open('words.txt') as file: 
        newwords = file.read() 
        if words != newwords: 
            words = newwords 
        try: 
            print newwords 
            stream.fetch("/1.1/statuses/filter.json?track="+tornado.escape.url_escape(words), callback=callback) 
        except: 
            pass 
        file.close() 
 
interval_ms = 1000*10 
scheduler = tornado.ioloop.PeriodicCallback(check_words,interval_ms,io_loop = main_io_loop) 
scheduler.start() 
main_io_loop.start() 

这是我得到的错误

ERROR:root:Uncaught exception, closing connection. 
Traceback (most recent call last): 
  File "/home/user/PycharmProjects/observrenv/local/lib/python2.7/site-packages/tornado/iostream.py", line 305, in wrapper 
    callback(*args) 
  File "/home/user/PycharmProjects/observrenv/src/tweetstream/tweetstream.py", line 155, in on_connect 
    self._twitter_stream.read_until("\r\n\r\n", self.on_headers) 
  File "/home/user/PycharmProjects/observrenv/local/lib/python2.7/site-packages/tornado/iostream.py", line 151, in read_until 
    self._set_read_callback(callback) 
  File "/home/user/PycharmProjects/observrenv/local/lib/python2.7/site-packages/tornado/iostream.py", line 369, in _set_read_callback 
    assert not self._read_callback, "Already reading" 
AssertionError: Already reading 
ERROR:root:Exception in callback <tornado.stack_context._StackContextWrapper object at 0x2415cb0> 
Traceback (most recent call last): 
  File "/home/user/PycharmProjects/observrenv/local/lib/python2.7/site-packages/tornado/ioloop.py", line 421, in _run_callback 
    callback() 
  File "/home/user/PycharmProjects/observrenv/local/lib/python2.7/site-packages/tornado/iostream.py", line 305, in wrapper 
    callback(*args) 
  File "/home/user/PycharmProjects/observrenv/src/tweetstream/tweetstream.py", line 155, in on_connect 
    self._twitter_stream.read_until("\r\n\r\n", self.on_headers) 
  File "/home/user/PycharmProjects/observrenv/local/lib/python2.7/site-packages/tornado/iostream.py", line 151, in read_until 
    self._set_read_callback(callback) 
  File "/home/user/PycharmProjects/observrenv/local/lib/python2.7/site-packages/tornado/iostream.py", line 369, in _set_read_callback 
    assert not self._read_callback, "Already reading" 
AssertionError: Already reading 

我通过在调用 check_words 时再次启动 ioloop 获得了更好的结果(不是最好的)。

stream = tweetstream.TweetStream(configuration,ioloop=main_io_loop) 
 
stream.fetch("/1.1/statuses/filter.json?track="+tornado.escape.url_escape(words), callback=callback) 
 
 
def check_words(): 
    global words, stream 
    with open('words.txt') as file: 
        newwords = file.read() 
    if words != newwords: 
        words = newwords 
        print newwords 
        try: 
            stream = tweetstream.TweetStream(configuration,ioloop=main_io_loop) 
            stream.fetch("/1.1/statuses/filter.json?track="+tornado.escape.url_escape(words), callback=callback) 
            interval_ms = 1000*10 
            scheduler = tornado.ioloop.PeriodicCallback(check_words,interval_ms,io_loop = main_io_loop) 
            scheduler.start() 
            main_io_loop.start() 
        except: 
            pass 
        file.close() 
 
 
interval_ms = 1000*10 
scheduler = tornado.ioloop.PeriodicCallback(check_words,interval_ms,io_loop = main_io_loop) 
scheduler.start() 
main_io_loop.start() 

请您参考如下方法:

据说here由 Twitter 员工推荐，建议是做我已经在做的事情(但以更温和的方式)。如果您的查询条件发生变化，只需重新连接一次。否则只是保持连接打开。监控 Twitter 可能发送给您的错误或您可能被禁止的错误也很重要。