Skip to main content
 首页 » 编程设计

python之跟踪哪个(tweepy)过滤器捕获了一条推文

2025年02月15日9duanxz

我需要在 twitter 上跟踪许多关键字并将推文发送到 MongoDB。我将其用于我的代码:

How can I consume tweets from Twitter's streaming api and store them in mongodb

import json 
import pymongo 
import tweepy 
 
consumer_key = "" 
consumer_secret = "" 
access_key = "" 
access_secret = "" 
 
auth = tweepy.OAuthHandler(consumer_key, consumer_secret) 
auth.set_access_token(access_key, access_secret) 
api = tweepy.API(auth) 
 
 
class CustomStreamListener(tweepy.StreamListener): 
    def __init__(self, api): 
        self.api = api 
        super(tweepy.StreamListener, self).__init__() 
 
        self.db = pymongo.MongoClient().test 
 
    def on_data(self, tweet): 
        self.db.tweets.insert(json.loads(tweet)) 
 
    def on_error(self, status_code): 
        return True # Don't kill the stream 
 
    def on_timeout(self): 
        return True # Don't kill the stream 
 
 
sapi = tweepy.streaming.Stream(auth, CustomStreamListener(api)) 
 
to_track = ['keyword1', 'keyword2', 'keyword3'] 
 
sapi.filter(track = to_track) 

有没有办法让我跟踪每个推文的关键字? (无需在每个中进行 grep 搜索)

请您参考如下方法:

我不确定 on_data 函数是如何工作的,但你可以使用 on_status 并执行如下操作:

import tweepy 
consumer_key = '' 
consumer_secret = '' 
access_key = '' 
access_secret = '' 
 
 
 
auth = tweepy.OAuthHandler(consumer_key, consumer_secret) 
auth.set_access_token(access_key, access_secret) 
api = tweepy.API(auth) 
 
 
class CustomStreamListener(tweepy.StreamListener):     
    def on_status(self, status): 
        tweet = status.text         
        words = tweet.split() 
        if 'keyword1' in words: 
            print "do something with keyword1" 
            self.db.tweets.insert(json.loads(tweet)) 
        if 'keyword2' in words: 
            print "do something with keyword2" 
            self.db.tweets.insert(json.loads(tweet)) 
        if 'keyword3' in words: 
            print "do something with keyword3" 
            self.db.tweets.insert(json.loads(tweet)) 
sapi = tweepy.streaming.Stream(auth, CustomStreamListener(api)) 
 
to_track = ['keyword1', 'keyword2', 'keyword3'] 
 
sapi.filter(track = to_track)