How to go about reading a web page lazily in Clojure

Question

I and a friend recently implemented link grabbing in my Clojure IRC bot. When it sees a link, it slurps the page and grabs the title from the page. The problem is that it has to slurp the ENTIRE page just to grab the link.

How does one go about reading a page lazily until the first </title>?

Answer 1

Use line-seq but don't forget to close the underlying stream when done.