Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Find partial class names in spans with Beautiful Soup

This page https://www.kijiji.ca/v-1-bedroom-apartments-condos/ville-de-montreal/1-chambre-chauff-eau-chaude-incl-vsl-514-856-0038/1334431659 contains this span class:

<span class="currentPrice-3131760660"><span content="800.00">800,00 $</span>

I'm trying to automatically extract the price (800$ in this case). Over time, however, the number after "currentPrice-" changes, and my Python script ceases to work. I am using this Beautiful soup function:

soup.find_all('span', {'class' : 'currentPrice-3131760660'})

How can I use find_all to extract partial matches of class names, such as all classes containing the string "currentPrice-"?

like image 949
Lucien S. Avatar asked Dec 06 '22 11:12

Lucien S.


2 Answers

According to the docs you have several options:

  • Use a regex:

    soup.find_all('span', attrs={'class': re.compile('^currentPrice.*')})
    
  • Use a function:

    soup.find_all('span',
                  attrs={'class': lambda e: e.startswith('currentPrice') if e else False})
    
like image 151
DeepSpace Avatar answered Jan 05 '23 00:01

DeepSpace


You could try a CSS selector soup.select('span[class*="currentPrice-"]')

like image 26
jwebb Avatar answered Jan 04 '23 23:01

jwebb