Breaking News: Grepper is joining You.com. Read the official announcement!

Fetch all links from a given webpage

Harendra answered on May 12, 2022 Popularity 3/10 Helpfulness 1/10

answer Fetch all links from a given webpage

Fetch all links from a given webpage

Comment

import requests as rq
from bs4 import BeautifulSoup

url = input("Enter Link: ")
if ("https" or "http") in url:
    data = rq.get(url)
else:
    data = rq.get("https://" + url)
soup = BeautifulSoup(data.text, "html.parser")
links = []
for link in soup.find_all("a"):
    links.append(link.get("href"))

# Writing the output to a file (myLinks.txt) instead of to stdout
# You can change 'a' to 'w' to overwrite the file each time
with open("myLinks.txt", 'a') as saved:
    print(links[:10], file=saved)

Popularity 3/10 Helpfulness 1/10 Language python

Source: codingblog.online

Tags: fetch python webpage

Link to this answer
Share Copy Link