DotnetSpider
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
About
DotnetSpider is a web crawling and scraping framework built on .NET Standard, aimed at developers looking to simplify their web data extraction processes. It is lightweight and efficient, supporting distributed operations and cross-platform functionality. The library is compatible with various databases and can be integrated into applications using C# and .NET Core.
Open Source Health
- Stars
- 4,139
- Forks
- 1,052
- License
- MIT
- Last commit
- 6 months ago
Resources & Links
Related Categories
Vendor
Dotnetcore
Publisher of DotnetSpider, EasyCaching and SmartSql
Quick Links
Open Source
More by Dotnetcore
Related Products
Deep Research
An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine…
Shared categories
select.rs
A Rust library to extract useful data from HTML documents, suitable for web scraping.
Shared categories
Scrapely
A pure-python HTML screen-scraping library
Shared categories
Faster Than Requests
Faster requests on Python 3
Shared categories
MechanicalSoup
A Python library for automating interaction with websites.
Shared categories