I am trying to scrape web results from the website: https://promedmail.org/promed-posts/ I have followed beutifulsoup. mechanical soup and mechanize so far unable to scrape the search results. The content does not show the search results when typed in US. Any idea on what am I doing wrong here? Answer As you mention bs4 you can mimic the POST request the