Skip to main content
 首页 » 编程设计

python之将 re.findall 创建的列表拆分为单个单词,然后计算每个单词的出现次数,按出现次数降序排列

2024年12月31日8qq78292959

我必须计算由 re.findall 创建的列表的每个元素中每个单词出现的次数。

例如: jobs = ["Java Developer","Data Scientist","Business Architect Process Mining","JavaScript Developer"]

jobs_split = ["Java","Developer","Data","Scientist","Business","Architect", "Process","Mining","JavaScript","Developer"]

然后计算每个单词出现的次数并显示出来。在文件中作为 Word:出现次数

我知道我可以在 python 中构建“计数器”,但是我不知道如何拆分列表中的所有元素

import urllib.request 
import re 
from collections import Counter 
 
jobs = [] 
jobs_split = [] 
 
from urllib.request import urlopen, Request 
for i in range(10): 
    html = Request("https://mysite?pn={}".format(i), headers={'User-Agent':         'Mozilla/5.0'}) 
page = urlopen(html).read().decode('utf-8') 
 
jobs += re.findall(r'"@type":"JobPosting","title":"([A-Za-z0-9 -/]+)","description"', page) 
 
my_set = set(jobs) 
# print(Counter(my_set)) 
print(my_set) 

请您参考如下方法:

你可以使用 itertools.chain将所有单词加入一个可迭代对象中:

from collections import Counter 
from itertools import chain 
 
jobs = ["Java Developer","Data Scientist","Business Architect Process Mining","JavaScript Developer"] 
 
tokens = chain.from_iterable(job.split() for job in jobs) 
counts = Counter(tokens) 
 
print(counts) 

输出

Counter({'Developer': 2, 'JavaScript': 1, 'Architect': 1, 'Process': 1, 'Mining': 1, 'Business': 1, 'Scientist': 1, 'Java': 1, 'Data': 1})