Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Java - Obtain text within script tag using Jsoup

I am using the Jsoup library to read a URL. This url has text within a few <script> tags. Is it possible for me to obtain the text within each <script> tag? Please note that I am not asking to parse a Javascript file as I am already aware JSoup does not allow that. The actual source code of the URL has text within a script tag, I need that.

doc = Jsoup.connect("http://www.example.com").timeout(10000).get();

Element div = doc.select("script").first();
for (Element element : div.children()) {
System.out.println(element.toString());
}

This is what one of the script tags look like from the source code:

<script type="text/javascript">
(function() {
...
})();
</script>
like image 679
Matt9Atkins Avatar asked May 27 '13 21:05

Matt9Atkins


3 Answers

Alternatively, you could use the Element#html() method that returns the inner html of an element.

Since 1.11.1: Use efficient Element#selectFirst() method to find the script element.

Document doc = Jsoup.connect("http://www.example.com").timeout(10000).get();
Element scriptElement = doc.selectFirst("script");

// Don't forget to check scriptElement is not null...

String jsCode = scriptElement.html(); 

Up to Jsoup 1.10.3: Combine Element#select() and Elements#first() calls to find the script element.

Document doc = Jsoup.connect("http://www.example.com").timeout(10000).get();
Element scriptElement = doc.select("script").first();

// Don't forget to check scriptElement is not null...

String jsCode = scriptElement.html(); 
like image 200
Stephan Avatar answered Oct 17 '22 12:10

Stephan


Yes. You can use Element#getElementsByTag() to get all the script tag . Each script tags will be represented by the DataNode.

 Document doc =Jsoup.connect("http://stackoverflow.com/questions/16780517/java-obtain-text-within-script-tag-using-jsoup").timeout(10000).get();
 Elements scriptElements = doc.getElementsByTag("script");

 for (Element element :scriptElements ){                
        for (DataNode node : element.dataNodes()) {
            System.out.println(node.getWholeData());
        }
        System.out.println("-------------------");            
  }
like image 29
Ken Chan Avatar answered Oct 17 '22 13:10

Ken Chan


Document doc = Jsoup.parse(html);
Elements scripts = doc.getElementsByTag("script");
for (Element script : scripts) {
    System.out.println(script.data());
}
like image 38
Mojtaba Yeganeh Avatar answered Oct 17 '22 14:10

Mojtaba Yeganeh