Beautiful Soup: extracting from deeply nested <div>'s

Question

Trying to extract Message text from:

<div class="Item ItemDiscussion Role_Member" id="Discussion_2318">
<div class="Discussion">
<div class="Item-BodyWrap">
<div class="Item-Body">
<div class="Message">
                Hello<br/>I have a very interesting observation on nature of birds in Alaska ...  <br/>
 Was there  10/19/18 has anyone heard of this     </div>
<div class="ReactionRecord"></div><div class="Reactions"></div> </div>
</div>
</div>
</div>

I have got this bit with:

tag = soup.find('div', {'class' : 'ItemDiscussion'})

Next I am trying to go down with:

s = str((tag.contents)[1])
sp = BeautifulSoup(s)
sp.contents

But this does not help much. How to get message text from <div class="Message"> ?

Answer 1

you can find the element from soup directly.

discussion_div = soup.find("div", {"class": "ItemDiscussion"})
message_text = discussion_div.find("div", {"class": "Message"}).text