PHP Spider
A configurable and extensible PHP web spider
About
PHP-Spider is a web spider built in PHP that allows users to crawl websites and extract data. It supports various traversal algorithms, depth limiting, and custom URI discovery logic using XPath or CSS selectors. The spider also includes features for caching, custom request handling, and statistics collection, making it suitable for developers looking to implement web scraping solutions without JavaScript support.
Open Source Health
- Stars
- 1,339
- Forks
- 229
- License
- MIT
- Last commit
- 2 months ago
Related Categories
Vendor
Matthijs van den Bos
Open-source project on GitHub: PHP Spider
Quick Links
Open Source
Related Products
Deep Research
An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine…
Shared categories
select.rs
A Rust library to extract useful data from HTML documents, suitable for web scraping.
Shared categories
Scrapely
A pure-python HTML screen-scraping library
Shared categories
Faster Than Requests
Faster requests on Python 3
Shared categories
MechanicalSoup
A Python library for automating interaction with websites.
Shared categories