crawler

infinilabs

🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)

scraping crawling elasticsearch crawler

View on GitHub

309 Stars

83 Forks

309 Watchers

Go Language

other License

Cost to Build

$4.98M

Market Value

$16.05M

How is this calculated?

Growth over time

32 data points · 2018-09-01 → 2025-09-01

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about crawler

Question copied to clipboard

What is the infinilabs/crawler GitHub project? Description: "🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)". Written in Go. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone crawler

Clone via HTTPS

git clone https://github.com/infinilabs/crawler.git

Clone via SSH

[email protected]:infinilabs/crawler.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the crawler issue tracker:

Open GitHub Issues

Similar to crawler

scrapy requests-html webmagic colly headless-chrome-crawler Embed artoo instagram-scraper django-dynamic-scraper scrapy-cluster Lulu newcrawler panther facebook_data_analyzer ImageScraper scrapple parsel nickjs jsoup-annotations jekyll Sasila Musoq goose-parser arachnid lambdasoup geeksforgeeks.pdf scrapy-zyte-smartproxy sqrape comic-dl newspaper