Skip to main content
 首页 » 编程设计

python之kombu.exceptions.EncodeError : [Vkwallpost: Vkwallpost object> . .. 不是 JSON 可序列化的之仅在本地主机上

2025年05月04日8zfyouxi

我正在使用 Django + Celery + Kombu + rabbitmq:我的任务在服务器 (Ubuntu 14.04) 上成功完成

[2016-01-21 02:29:05,027: INFO/MainProcess] Task vk_wall.tasks.get_wallposts_by_owner_id[cbdfbdf7-1f01-4cf1-bd5a-77fae7a07003] succeeded in 7.826467196922749s: [<Vkwallpost: Vkwallpost object>, <Vkwallpost: Vkwallpost object>, <Vkwallpost: Vkwallpost object>, <Vkwallpost: Vkwallpost... 

但在具有相同设置的本地主机 (Windows 7) 上会引发错误:

[2016-01-21 02:34:54,296: ERROR/MainProcess] Task vk_wall.tasks.get_wallposts_by_owner_id[5ecbf611-15d7-4b75-ac8e-2575b5dc869a] raised unexpected: EncodeError(TypeError(TypeError("[<Vkwallpost: Vkwallpost object>, <Vkwallpost: Vkwallpost object>, <Vkwallpost: Vkwallpost object>, <Vkwallpost: Vkwallpost object>, <Vkwallpost: Vkwallpost object>, <Vkwallpost: Vkwallpost object>, '...(remaining elements truncated)...'] is not JSON serializable",),),) 
Traceback (most recent call last): 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\celery\app\trace.py", line 283, in trace_task 
    uuid, retval, SUCCESS, request=task_request, 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\celery\backends\amqp.py", line 136, in store_result 
    delivery_mode=self.delivery_mode, 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\kombu\messaging.py", line 165, in publish 
    compression, headers) 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\kombu\messaging.py", line 241, in _prepare 
    body) = dumps(body, serializer=serializer) 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\kombu\serialization.py", line 164, in dumps 
    payload = encoder(data) 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\contextlib.py", line 77, in __exit__ 
    self.gen.throw(type, value, traceback) 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\kombu\serialization.py", line 59, in _reraise_errors 
    reraise(wrapper, wrapper(exc), sys.exc_info()[2]) 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\kombu\five.py", line 131, in reraise 
    raise value.with_traceback(tb) 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\kombu\serialization.py", line 55, in _reraise_errors 
    yield 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\kombu\serialization.py", line 164, in dumps 
    payload = encoder(data) 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\anyjson\__init__.py", line 141, in dumps 
    return implementation.dumps(value) 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\anyjson\__init__.py", line 89, in dumps 
    raise TypeError(TypeError(*exc.args)).with_traceback(sys.exc_info()[2]) 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\anyjson\__init__.py", line 87, in dumps 
    return self._encode(data) 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\simplejson\__init__.py", line 370, in dumps 
    return _default_encoder.encode(obj) 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\simplejson\encoder.py", line 269, in encode 
    chunks = self.iterencode(o, _one_shot=True) 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\simplejson\encoder.py", line 348, in iterencode 
    return _iterencode(o, 0) 
  File "M:\WinPython-64bit-3.4.3.2\python-3.4.3.amd64\lib\site-packages\simplejson\encoder.py", line 246, in default 
    raise TypeError(repr(o) + " is not JSON serializable") 
kombu.exceptions.EncodeError: [<Vkwallpost: Vkwallpost object>, <Vkwallpost: Vkwallpost object>, <Vkwallpost: Vkwallpost object>, <Vkwallpost: Vkwallpost object>, <Vkwallpost: Vkwallpost object>, <Vkwallpost: Vkwallpost object>, '...(remaining elements truncated)...'] is not JSON serializable 

所以任务标记为未完成,但实际上任务完成了我需要的所有事情。 我查看了类似问题的答案:我的任务返回字典,即 {'success': success}。看起来,它试图序列化作为 Django 模型实例的 Vkwallpost 对象,但为什么。

我的设置.py:

#BROKER_URL = 'amqp://guest:guest@localhost//' 
BROKER_URL = 'django://' 
 
#: Only add pickle to this list if your broker is secured 
#: from unwanted access (see userguide/security.html) 
CELERY_ACCEPT_CONTENT = ['json', 'pickle'] 
CELERY_TASK_RESULT_EXPIRES=3600 
#CELERY_RESULT_BACKEND='amqp' 
CELERY_RESULT_BACKEND='djcelery.backends.database:DatabaseBackend' 
# postgresql 
#CELERY_RESULT_BACKEND = 'db+postgresql://postgres:111222@localhost/graphgrail' 
#CELERY_RESULT_BACKEND='djcelery.backends.cache:CacheBackend', 
CELERY_RESULT_SERIALIZER = 'json' #json pickle msgpack 
CELERY_TASK_SERIALIZER = 'json' 
CELERY_IMPORTS=["vk_wall.tasks"] 

请您参考如下方法:

对象不是 JSON 可序列化的。如果序列化在 Linux 上成功,则表明您可能正在那里使用 pickle 序列化方法。

我建议在 Windows 中使用 pickle 序列化方法,方法是使用提到的方法之一显式指定它 here .