Package org.jweaver.crawler

Interface JWeaverCrawler

All Known Implementing Classes:
JWeaverCrawlerImpl
public interface JWeaverCrawler
Represents the JWeaverCrawler abstract class, which facilitates web crawling operations. This class provides methods for executing the crawler either in parallel or sequentially. Users can customize various attributes of the crawler with the Builder pattern.

  • Nested Class Summary

    Nested Classes
    Modifier and Type
    Interface
    Description
    static interface 
    JWeaverCrawler.Builder
    The Builder interface provides methods for building and customize an instance of JWeaverCrawler.

  • Method Summary

    Modifier and Type
    Method
    Description
    static JWeaverCrawler.Builder
    builder()
    Returns a new instance of the builder for configuring and creating a JWeaverCrawler.
    void
    run()
    Runs the executions sequentially.
    void
    runParallel()
    This should be the preferred choice to run the crawler.

  • Method Details

    • builder

      static JWeaverCrawler.Builder builder()
      Returns a new instance of the builder for configuring and creating a JWeaverCrawler.
      Returns:
      A new instance of the builder.

    • runParallel

      void runParallel()
      This should be the preferred choice to run the crawler.

      Runs the different JWeaverTask in parallel using Virtual Threads, crawling multiple uris (of different hosts) concurrently.

    • run

      void run()
      Runs the executions sequentially.

      Consider using runParallel() for improved performance.