crawler4j example | java web crawler

Crawler4j is a framework using which we can create a multi-threaded crawler with some extra features like Logging, customisations, crawling password protected sites etc.

Here is a small example of starting with crawler4j.
Build env :Maven

1.Create a simple maven project.

2. Create a helper class having the logic. Below is the sample class

Create the controller having the main method.

pom.xml

Download Link to the example.
crawler4j example with maven

Leave a Reply

Your email address will not be published. Required fields are marked *

Blue Captcha Image
Refresh

*