I am using Anemone. How do I crawl sub-domain too? for e.g if I have website www.abc.com my crawler should also crawl support.abc.com or blah.abc.com. I am using Ruby 1.8.7 and Rails 3.
Here is a commit on Github that solves your problem.
https://github.com/runa/anemone/commit/91559bde052956cfc40ae62678ec2a61574cf928
Change your anemone gem files as per the link.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With