Skip to main content
 首页 » 编程设计

python之使用 Python 抓取 PDF 文本 (pdfquery)

2024年12月31日10飞鱼

我需要抓取一些 PDF 文件以提取以下文本信息:

我尝试使用 pdfquery 来做到这一点,方法是处理我在 Reddit 上找到的一个示例(参见第一篇文章):https://www.reddit.com/r/Python/comments/4bnjha/scraping_pdf_files_with_python/

我想通过获取许可证号来测试它。我进入生成的“xmltree”文件,找到第一个许可证号并在 LTTextLineHorizo​​ntal 元素中获得 x0、y0、x1、y1 坐标。

import pdfquery 
from lxml import etree 
 
 
PDF_FILE = 'C:\\TEMP\\ad-4070-20-september-2018.pdf' 
 
pdf = pdfquery.PDFQuery(PDF_FILE) 
pdf.load(4,5) 
 
with open('xmltree.xml','wb') as f: 
    f.write(etree.tostring(pdf.tree, pretty_print=True)) 
 
product_info = [] 
page_count = len(pdf._pages) 
for pg in range(page_count): 
    data = pdf.extract([ 
        ('with_parent', 'LTPage[pageid="{}"]'.format(pg+1)), 
        ('with_formatter', None), 
        ('product_name', 'LTTextLineHorizontal:in_bbox("89.904, 757.502, 265.7, 770.83")'), 
        ('product_details', 'LTTextLineHorizontal:in_bbox("223, 100, 737, 1114")'), 
    ]) 
    for ix, pn in enumerate(sorted([d for d in data['product_name'] if d.text.strip()], key=lambda x: x.get('y0'), reverse=True)): 
        product_info.append({'Manufacturer': pn.text.strip(), 'page': pg, 'y_start': float(pn.get('y1')), 'y_end': float(pn.get('y1'))-150}) 
        # if this is not the first product on the page, update the previous product's y_end with a 
        # value slightly greater than this product's y coordinate start 
        if ix > 0: 
            product_info[-2]['y_end'] = float(pn.get('y0')) 
    # for every product found on this page, find the detail information that falls between the 
    # y coordinates belonging to the product 
    for product in [p for p in product_info if p['page'] == pg]: 
        details = [] 
        for d in sorted([d for d in data['product_details'] if d.text.strip()], key=lambda x: x.get('y0'), reverse=True): 
            if  product['y_start'] > float(d.get('y0')) > product['y_end']: 
                details.append(d.text.strip()) 
        product['Details'] = ' '.join(details) 
pdf.file.close() 
 
for p in product_info: 
    print('Manufacturer: {}\r\nDetail Info:{}...\r\n\r\n'.format(p['Manufacturer'], p['Details'][0:100])) 

但是,当我运行它时,它没有打印任何内容。没有错误,XML 文件生成正常,我直接从 XML 文件中获取坐标,所以应该没有问题。我做错了什么?

请您参考如下方法:

要从 PDF 文件中提取文本,我最喜欢的工具是 pdftotext。

使用 -layout 选项,您基本上可以得到纯文本,使用 Python 操作起来相对容易。

示例如下:

"""Extract text from PDF files. 
 
Requires pdftotext from the poppler utilities. 
On unix/linux install them using your favorite package manager. 
 
Binaries for ms-windows can be found at; 
1) VERY OLD 32 bit http://blog.alivate.com.au/poppler-windows/   
   RECENT 64 bit https://github.com/oschwartz10612/poppler-windows 
2) https://sourceforge.net/projects/poppler-win32/ 
""" 
 
import subprocess 
 
 
def pdftotext(pdf, page=None): 
    """Retrieve all text from a PDF file. 
 
    Arguments: 
        pdf Path of the file to read. 
        page: Number of the page to read. If None, read all the pages. 
 
    Returns: 
        A list of lines of text. 
    """ 
    if page is None: 
        args = ['pdftotext', '-layout', '-q', pdf, '-'] 
    else: 
        args = ['pdftotext', '-f', str(page), '-l', str(page), '-layout', 
                '-q', pdf, '-'] 
    try: 
        txt = subprocess.check_output(args, universal_newlines=True) 
        lines = txt.splitlines() 
    except subprocess.CalledProcessError: 
        lines = [] 
    return lines