Python tool to extract metadata, contacts, and social profiles from any website URL.

Firecrawl.dev is a web data API that crawls and extracts clean, structured web content optimized for LLM and AI applications.

using wget to clone an entire website for offline access and Markdown conversion