I'm trying to parse a website to pull out some data that is stored in the body such as this:
<body>
<b>INFORMATION</b>
Hookups: None
Group Sites: No
Station: No
<b>Details</b>
Ramp: Yes
</body>
I would like to use BeautifulSoup4 and RegEx to pull out the values for Hookups and Group Sites and so on, but I am new to both bs4 and RegEx. I have tried the following to get the Hookups Value:
soup = BeautifulSoup(open('doc.html'))
hookups = soup.find_all(re.compile("Hookups:(.*)Group"))
But the search comes back empty.
BeautifulSoup's find_all
only works with tags. You can actually use just a pure regex to get what you need assuming the HTML is this simple. Otherwise you can use find_all
and then get the .text
nodes.
re.findall("Hookups: (.*)", open('doc.html').read())
You can also search by tag content with the text
property as of BeautifulSoup 4.2
soup.find_all(text=re.compile("Hookups:(.*)Group"));
EDIT: Since BeautifulSoup 4.4, the text
argument is named string
.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With