Skip to main content
 首页 » 编程设计

python Selenium : Can't find element by xpath when browser is headless

2025年01月19日11lautakyan007

我正在尝试使用以下代码使用 Python Selenium 登录网站:

import time 
from contextlib import contextmanager 
from selenium import webdriver 
from selenium.webdriver.chrome.options import Options 
 
@contextmanager 
def getBrowser(*options): 
    chrome_options = Options() 
    if options: [chrome_options.add_argument(option) for option in options] 
    browser = webdriver.Chrome(chrome_options=chrome_options) 
    try: 
        yield browser 
    finally: 
        browser.quit() 
 
 
with getBrowser() as browser: 
    browser.get('https://www.vinted.com/members/notifications') 
 
    time.sleep(20) 
    browser.find_element_by_xpath('//*[@id="content"]/div/div[2]/div/div/div[6]/div[3]/div[3]/a/span').click() 

它工作得很好,但是当我向浏览器添加 --headless 选项时,它引发了一个 NoSuchElementException。

代码错误:

with getBrowser('--headless') as browser: 
    browser.get('https://www.vinted.com/members/notifications') 
 
    time.sleep(20) 
    browser.find_element_by_xpath('//*[@id="content"]/div/div[2]/div/div/div[6]/div[3]/div[3]/a/span').click() 

回溯:

Traceback (most recent call last): 
 
  File "<ipython-input-4-fe0834deb137>", line 1, in <module> 
    runfile('C:/Users/Alec/vinted test case.py', wdir='C:/Users/Alec') 
 
  File "C:\Users\Alec\Anaconda3\lib\site-packages\spyder\utils\site\sitecustomize.py", line 705, in runfile 
    execfile(filename, namespace) 
 
  File "C:\Users\Alec\Anaconda3\lib\site-packages\spyder\utils\site\sitecustomize.py", line 102, in execfile 
    exec(compile(f.read(), filename, 'exec'), namespace) 
 
  File "C:/Users/Alec/vinted test case.py", line 27, in <module> 
    browser.find_element_by_xpath('//*[@id="content"]/div/div[2]/div/div/div[6]/div[3]/div[3]/a/span').click() 
 
  File "C:\Users\Alec\selenium\webdriver\remote\webdriver.py", line 354, in find_element_by_xpath 
    return self.find_element(by=By.XPATH, value=xpath) 
 
  File "C:\Users\Alec\selenium\webdriver\remote\webdriver.py", line 832, in find_element 
    'value': value})['value'] 
 
  File "C:\Users\Alec\selenium\webdriver\remote\webdriver.py", line 297, in execute 
    self.error_handler.check_response(response) 
 
  File "C:\Users\Alec\selenium\webdriver\remote\errorhandler.py", line 194, in check_response 
    raise exception_class(message, screen, stacktrace) 
 
NoSuchElementException: no such element: Unable to locate element: {"method":"xpath","selector":"//*[@id="content"]/div/div[2]/div/div/div[6]/div[3]/div[3]/a/span"} 
  (Session info: headless chrome=65.0.3325.181) 
  (Driver info: chromedriver=2.36.540470 (e522d04694c7ebea4ba8821272dbef4f9b818c91),platform=Windows NT 10.0.16299 x86_64) 

此错误仅在浏览器 headless 时发生。是什么导致了这种行为?它可以在 headless 模式下工作吗?

目标 HTML:

<div class="u-flex-grow"> 
      <a class="c-button--inverse c-button--normal c-button--amplified c-button " href="/member/general/login?ref_url=%2Fmembers%2Fnotifications"><span class="c-button__content">Log In</span></a> 
    </div> 

请您参考如下方法:

我遇到了同样的问题。解决方案是添加 usr-agent:

user_agent = 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36' 
chrome_options.add_argument('user-agent={0}'.format(user_agent)) 

通过打印页面找到了原因

browser.get(url) 
print(browser.page_source) 

然后返回的 html 显示权限被拒绝,所以我用谷歌搜索。 按照解决方案: How to access a site via a headless driver without being denied permission