DotnetSpider
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
Web CrawlingOpen Source Developer ToolsOpen Source
About
DotnetSpider is a web crawling and scraping framework built on .NET Standard, aimed at developers looking to simplify their web data extraction processes. It is lightweight and efficient, supporting distributed operations and cross-platform functionality. The library is compatible with various databases and can be integrated into applications using C# and .NET Core.
Open Source Health
- Stars
- 4,139
- Forks
- 1,052
- License
- MIT
- Last commit
- 6 months ago
C#
Alternatives to DotnetSpider
Deep Researchby David ZhangAn AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine…- select.rsby Utkarsh KukretiA Rust library to extract useful data from HTML documents, suitable for web scraping.
Scrapelyby ScrapyA pure-python HTML screen-scraping library- Faster Than Requestsby Juan CarlosFaster requests on Python 3
MechanicalSoupby MechanicalSoupA Python library for automating interaction with websites.
Resources & Links
Related Categories
Using DotnetSpider?
Track its cost next to the rest of your stack and get a reminder before it renews.
Add to my stackVendor
Dotnetcore
Publisher of DotnetSpider, EasyCaching and SmartSql