Breaking News: Grepper is joining You.com. Read the official announcement!

python scrape data from aspx page

Gegasoft answered on October 29, 2020 Popularity 6/10 Helpfulness 2/10

answer python scrape data from aspx page

python scrape data from aspx page

Comment

#pip install requests
#pip install lxml
#pip install bs4
import requests
from bs4 import BeautifulSoup

r_obj = requests.Session()
url = "aspx_website_url_here" # i.e. http://bisegrw.edu.pk/
r_soup = r_obj.get(url)
soup = BeautifulSoup(r_soup.content , "lxml")

hidden_inputs = soup.find_all("input",type="hidden")

data = {
hidden_inputs[0]['name']:hidden_inputs[0]['value'],
hidden_inputs[1]['name']:hidden_inputs[1]['value'],
hidden_inputs[2]['name']:hidden_inputs[2]['value'],
'other_input':'value',  # i.e. 'rno':'487431',
'submitButton':'submit'}

url_needed = "aspx_endpoint" # i.e. http://bisegrw.edu.pk/result-card-matric.html
final = r_obj.post(url_needed,verify=False,data=data)
soup1 = BeautifulSoup(final.content,"lxml")
detail_tab = soup1.find_all("table")

Popularity 6/10 Helpfulness 2/10 Language python

Source: Grepper

Tags: python scrape

Link to this answer
Share Copy Link

Contributed on Oct 29 2020

Gegasoft

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

python scrape data from aspx page

Contents

More Related Answers

python scrape data from aspx page

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.