RError.com

RError.com Logo RError.com Logo

RError.com Navigation

  • 主页

Mobile menu

Close
  • 主页
  • 系统&网络
    • 热门问题
    • 最新问题
    • 标签
  • Ubuntu
    • 热门问题
    • 最新问题
    • 标签
  • 帮助
主页 / 问题 / 1257594
Accepted
DarMaster
DarMaster
Asked:2022-03-18 19:17:48 +0000 UTC2022-03-18 19:17:48 +0000 UTC 2022-03-18 19:17:48 +0000 UTC

解析时出现 Requests.exceptions.InvalidSchema 错误

  • 772

我正在编写一个应该通过所有链接 en.wikipedia.org Category:Animals_alphabetically ( https://ru.wikipedia.org/w/index.php?title=Category:Animals_alphabetically&from=А ) 的代码,但是在网站上链接不会更改数字(.../page = 1..),并且 pagefrom=Azov+button(链接取决于页面上的第一个动物)。因此,有必要走更艰难的路。

代码算法如下:

  1. 从按钮中获取链接 # 该站点有一个“下一页”按钮。
  2. 按照链接
  3. 重复
  4. 停在最后一个链接(我自己开的)
import  requests
from bs4 import BeautifulSoup


def parser(url):
    html = requests.get(url).text
    soup = BeautifulSoup(html,'html.parser')
    return soup

    
def parser_next_link():
    soup = parser(url)
    result_a = soup.find_all('a',{'title':'Категория:Животные по алфавиту'})
    for i in result_a:
        if i.get_text() == 'Следующая страница':
            link = 'ru.wikipedia.org/' + i.get('href')
            # Нам нужна, только первая ссылка т.к. вторая её дублирует
            break
    return link


wiki_link = ['https://ru.wikipedia.org/w/index.php?title=Категория:Животные_по_алфавиту&subcatfrom=0&filefrom=0&pageuntil=Азовская+пуголовка#mw-pages']

for i in wiki_link:
    url = i 
    wiki_link.append(parser_next_link())
    # Последняя страница 
    if url == 'https://ru.wikipedia.org/w/index.php?title=Категория:Животные_по_алфавиту&pagefrom=Zabrus&subcatfrom=0&filefrom=0#mw-pages':
        break

输出:

Traceback (most recent call last):
  File "c:\Project_Py\test_2.py", line 26, in <module>
    wiki_link.append(parser_next_link())
  File "c:\Project_Py\test_2.py", line 12, in parser_next_link
    soup = parser(url)
  File "c:\Project_Py\test_2.py", line 6, in parser
    html = requests.get(url).text
  File "C:\Users\Владелец\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\requests\api.py", line 76, in get
    return request('get', url, params=params, **kwargs)
  File "C:\Users\Владелец\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\requests\api.py", line 61, in request
    return session.request(method=method, url=url, **kwargs)
  File "C:\Users\Владелец\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\requests\sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "C:\Users\Владелец\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\requests\sessions.py", line 649, in send
    adapter = self.get_adapter(url=request.url)
  File "C:\Users\Владелец\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\requests\sessions.py", line 742, in get_adapter
    raise InvalidSchema("No connection adapters were found for {!r}".format(url))
requests.exceptions.InvalidSchema: No connection adapters were found for 'ru.wikipedia.org//w/index.php?title=%D0%9A%D0%B0%D1%82%D0%B5%D0%B3%D0%BE%D1%80%D0%B8%D1%8F:%D0%96%D0%B8%D0%B2%D0%BE%D1%82%D0%BD%D1%8B%D0%B5_%D0%BF%D0%BE_%D0%B0%D0%BB%D1%84%D0%B0%D0%B2%D0%B8%D1%82%D1%83&pagefrom=%D0%90%D0%B7%D0%BE%D0%B2%D1%81%D0%BA%D0%B0%D1%8F+%D0%BF%D1%83%D0%B3%D0%BE%D0%BB%D0%BE%D0%B2%D0%BA%D0%B0&subcatfrom=%D0%90&filefrom=%D0%90#mw-pages'
PS C:\Project_Py> & C:/Users/Владелец/AppData/Local/Microsoft/WindowsApps/PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0/python.exe c:/Project_Py/test_2.py
Traceback (most recent call last):
  File "c:\Project_Py\test_2.py", line 26, in <module>        
    wiki_link.append(parser_next_link())
  File "c:\Project_Py\test_2.py", line 12, in parser_next_link
    soup = parser(url)
    resp = self.send(prep, **send_kwargs)
  File "C:\Users\Владелец\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\requests\sessions.py", line 649, in sendbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\requests\sessions.py", line 649, in send                                                                      bz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\requests\sessions.py", line 742, in get_adapter
    adapter = self.get_adapter(url=request.url)
  File "C:\Users\Владелец\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_q.org//w/index.php?title=%D0%9A%D0%B0%D1%82%D0%B5%D0%B3%D0%BE%D1%80%D0%B8%D1%8F:%D0%96%D0%B8%D0%B2%D0%BE%D1%82%D0%BD%D1%8bz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\requests\sessions.py", lD0%B7%D0%BE%D0%B2%D1%81%D0%BA%D0%B0%D1%8F+%D0%BF%D1%83%D0%B3%D0%BE%D0%BB%D0%BE%D0%B2%D0%BA%D0%B0&subcatfrom=%D0%90&filefine 742, in get_adapter
    raise InvalidSchema("No connection adapters were found for {!r}".format(url))     
requests.exceptions.InvalidSchema: No connection adapters were found for 'ru.wikipedia.org//w/index.php?title=%D0%9A%D0%B0%D1%82%D0%B5%D0%B3%D0%BE%D1%80%D0%B8%D1%8F:%D0%96%D0%B8%D0%B2%D0%BE%D1%82%D0%BD%D1%8B%D0%B5_%D0%BF%D0%BE_%D0%B0%D0%BB%D1%84%D0%B0%D0%B2%D0%B8%D1%82%D1%83&pagefrom=%D0%90%D0%B7%D0%BE%D0%B2%D1%81%D0%BA%D0%B0%D1%8F+%D0%BF%D1%83%D0%B3%D0%BE%D0%BB%D0%BE%D0%B2%D0%BA%D0%B0&subcatfrom=%D0%90&filefrom=%D0%90#mw-pages'

我意识到错误是递归的,但我也有一个停止条件。

python
  • 1 1 个回答
  • 10 Views

1 个回答

  • Voted
  1. Best Answer
    insolor
    2022-03-18T19:38:51Z2022-03-18T19:38:51Z

    requests.exceptions.InvalidSchema这种情况下请求通过的错误requests是由于url中没有指定协议(例如http或https)。只需将协议添加到地址的开头:

    link = 'https://ru.wikipedia.org/' + i.get('href')
    
    • 0

相关问题

  • 是否可以以某种方式自定义 QTabWidget?

  • telebot.anihelper.ApiException 错误

  • Python。检查一个数字是否是 3 的幂。输出 无

  • 解析多个响应

  • 交换两个数组的元素,以便它们的新内容也反转

Sidebar

Stats

  • 问题 10021
  • Answers 30001
  • 最佳答案 8000
  • 用户 6900
  • 常问
  • 回答
  • Marko Smith

    表格填充不起作用

    • 2 个回答
  • Marko Smith

    提示 50/50,有两个,其中一个是正确的

    • 1 个回答
  • Marko Smith

    在 PyQt5 中停止进程

    • 1 个回答
  • Marko Smith

    我的脚本不工作

    • 1 个回答
  • Marko Smith

    在文本文件中写入和读取列表

    • 2 个回答
  • Marko Smith

    如何像屏幕截图中那样并排排列这些块?

    • 1 个回答
  • Marko Smith

    确定文本文件中每一行的字符数

    • 2 个回答
  • Marko Smith

    将接口对象传递给 JAVA 构造函数

    • 1 个回答
  • Marko Smith

    正确更新数据库中的数据

    • 1 个回答
  • Marko Smith

    Python解析不是css

    • 1 个回答
  • Martin Hope
    Alexandr_TT 2020年新年大赛! 2020-12-20 18:20:21 +0000 UTC
  • Martin Hope
    Alexandr_TT 圣诞树动画 2020-12-23 00:38:08 +0000 UTC
  • Martin Hope
    Air 究竟是什么标识了网站访问者? 2020-11-03 15:49:20 +0000 UTC
  • Martin Hope
    Qwertiy 号码显示 9223372036854775807 2020-07-11 18:16:49 +0000 UTC
  • Martin Hope
    user216109 如何为黑客设下陷阱,或充分击退攻击? 2020-05-10 02:22:52 +0000 UTC
  • Martin Hope
    Qwertiy 并变成3个无穷大 2020-11-06 07:15:57 +0000 UTC
  • Martin Hope
    koks_rs 什么是样板代码? 2020-10-27 15:43:19 +0000 UTC
  • Martin Hope
    Sirop4ik 向 git 提交发布的正确方法是什么? 2020-10-05 00:02:00 +0000 UTC
  • Martin Hope
    faoxis 为什么在这么多示例中函数都称为 foo? 2020-08-15 04:42:49 +0000 UTC
  • Martin Hope
    Pavel Mayorov 如何从事件或回调函数中返回值?或者至少等他们完成。 2020-08-11 16:49:28 +0000 UTC

热门标签

javascript python java php c# c++ html android jquery mysql

Explore

  • 主页
  • 问题
    • 热门问题
    • 最新问题
  • 标签
  • 帮助

Footer

RError.com

关于我们

  • 关于我们
  • 联系我们

Legal Stuff

  • Privacy Policy

帮助

© 2023 RError.com All Rights Reserve   沪ICP备12040472号-5