dotnetcore/DotnetSpider
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
License & maintenance
MIT is a permissive license: free to use commercially with attribution.
Last code push 6 months ago.