Skip to main content
 首页 » 编程设计

python之向我的玻璃器皿的许多用户推送带有附件的同一张卡的最佳方法

2024年11月01日9lyj

我正在尝试清理我的代码并将其放入类似于产品的形状,但我在使用来自 Google App 引擎的产品环境时遇到了很多问题。 一切在本地都没有问题,但每次我尝试在产品上进行测试时,我都会遇到截止日期和超时问题。 我的问题是: 1)从我的玻璃器皿中向许多用户推送带有相同附件(视频)的相同卡的最佳/建议做法是什么。 这是从队列中调用的类:

class batchWorker(webapp2.RequestHandler): 
def post(self): 
    userToPush = self.request.get('user_id') 
    #posting video 
    media_link = util.get_full_url(self, '/static/video/short_from_glass_low.mp4') 
    resp = urlfetch.fetch(media_link, deadline=2000) 
    media_video = MediaIoBaseUpload(io.BytesIO(resp.content), mimetype='video/mp4', 
                                        resumable=False) 
    users = Credentials.all() 
    for user in users: 
            creds = StorageByKeyName(Credentials, user.key().name(), 'credentials').get() 
            mirror_service = util.create_service('mirror', 'v1', creds) 
            #first card 
            timeline_item01 = {'text':'New video from bundle - Test002'} 
            timeline_item01['bundleId'] = 'video_001' 
            timeline_item01['isBundleCover'] = 'true' 
            mirror_service.timeline().insert(body=timeline_item01).execute() 
            #second card 
            timeline_item = {'text': 'Text here'} 
            timeline_item['isBundleCover'] = 'false' 
            timeline_item['bundleId'] = 'video_001' 
            mirror_service.timeline().insert(body=timeline_item, media_body=media_video).execute() 
            logging.info("Posted video for user %s" % user.key().name()) 

这就是我将它推送到队列的方式:

taskqueue.add(url='/worker', params={'user_id': '103012621006129330069'}) 

有些时候我完成了这件事,有些时候我得到的日志如下:

2013-08-01 07:15:37.695 /worker 500 6481ms 0kb AppEngine-Google; (+http://code.google.com/appengine) 
I 2013-08-01 07:15:31.676 make: Got type <class 'google.appengine.api.datastore_types.Blob'> 
I 2013-08-01 07:15:31.677 validate: Got type <class 'oauth2client.client.OAuth2Credentials'> 
I 2013-08-01 07:15:31.711 make: Got type <class 'google.appengine.api.datastore_types.Blob'> 
I 2013-08-01 07:15:31.712 validate: Got type <class 'oauth2client.client.OAuth2Credentials'> 
I 2013-08-01 07:15:31.713 URL being requested: https://www.googleapis.com/discovery/v1/apis/mirror/v1/rest?userIp=0.1.0.2 
I 2013-08-01 07:15:31.770 URL being requested: https://www.googleapis.com/mirror/v1/timeline?alt=json 
I 2013-08-01 07:15:32.675 URL being requested: https://www.googleapis.com/upload/mirror/v1/timeline?uploadType=multipart&alt=json 
E 2013-08-01 07:15:37.685 The API call urlfetch.Fetch() took too long to respond and was cancelled. Traceback (most recent call last): File "/base/data/home/runtimes/python27 

一些其他的我得到了这个:

2013-08-01 07:15:11.066 /worker 500 7239ms 0kb AppEngine-Google; (+http://code.google.com/appengine) 
I 2013-08-01 07:15:04.434 make: Got type <class 'google.appengine.api.datastore_types.Blob'> 
I 2013-08-01 07:15:04.439 validate: Got type <class 'oauth2client.client.OAuth2Credentials'> 
I 2013-08-01 07:15:04.527 make: Got type <class 'google.appengine.api.datastore_types.Blob'> 
I 2013-08-01 07:15:04.528 validate: Got type <class 'oauth2client.client.OAuth2Credentials'> 
I 2013-08-01 07:15:04.529 URL being requested: https://www.googleapis.com/discovery/v1/apis/mirror/v1/rest?userIp=0.1.0.2 
I 2013-08-01 07:15:04.587 URL being requested: https://www.googleapis.com/mirror/v1/timeline?alt=json 
I 2013-08-01 07:15:04.620 Refreshing due to a 401 
I 2013-08-01 07:15:04.628 make: Got type <class 'google.appengine.api.datastore_types.Blob'> 
I 2013-08-01 07:15:04.629 validate: Got type <class 'oauth2client.client.OAuth2Credentials'> 
I 2013-08-01 07:15:04.630 Refreshing access_token 
I 2013-08-01 07:15:04.833 make: Got type <class 'google.appengine.api.datastore_types.Blob'> 
I 2013-08-01 07:15:04.834 validate: Got type <class 'oauth2client.client.OAuth2Credentials'> 
I 2013-08-01 07:15:04.839 validate: Got type <class 'oauth2client.client.OAuth2Credentials'> 
I 2013-08-01 07:15:04.839 get: Got type <class 'model.Credentials'> 
I 2013-08-01 07:15:05.970 URL being requested: https://www.googleapis.com/upload/mirror/v1/timeline?uploadType=multipart&alt=json 
E 2013-08-01 07:15:10.985 Deadline exceeded while waiting for HTTP response from URL: https://www.googleapis.com/upload/mirror/v1/timeline?uploadType=multipart&alt=json Traceba 

目前我有点灰心,因为我可以 100% 理解逻辑,但产品实现很痛苦。

是否需要使用batches calls才能一张张推送卡片? 有不同的方法吗? 当队列进程应该有 10 分钟的截止日期时,为什么我会遇到截止日期错误(截止日期错误在执行 10 秒后出现)。

请您参考如下方法:

超时实际上来自您的上传请求,您可以通过修改创建服务实例的代码 (util.create_service) 并设置一个 timeout 参数来解决这个问题实例化 httplib2.Http 对象时:

# Instantiate an Http instance 
http = httplib2.Http(timeout=2000) # Use a bigger value if you want to stay safe. 

关于批处理请求,不幸的是,API 不支持混合批处理和媒体上传请求...