Tag: web scraping

8 articles

xiaohongshumarkdownai workflowweb scrapingchrome extensionchinese content

Extract Xiaohongshu Posts to Markdown for AI

External scrapers often fail on Xiaohongshu. Here is a browser-first workflow for turning posts into clean Markdown for AI.

2026-06-238 min read

ragmarkdownweb scrapingvector databasechrome extensionai workflow

Web to Markdown RAG Pipeline: Clean Chunks

A practical RAG ingestion workflow for turning web pages into clean Markdown chunks, with where Web2MD fits against Firecrawl, Jina, and MarkItDown.

2026-06-218 min read

redditclaudemarkdownweb-scrapingai-contextchrome-extension

Scrape Reddit to Markdown for Claude

Use Reddit safely as Claude context without brittle anti-bot scraping. Here is when to use the API, Web2MD, or hosted tools.

2026-06-197 min read

firecrawlragmarkdownweb scrapingchrome extensionai tools

Cheap Firecrawl Alternatives for Hobby RAG

Building a hobby RAG pipeline? Compare Crawl4AI, Jina Reader, Trafilatura, Playwright, and Web2MD for clean Markdown ingestion.

2026-05-189 min read

ragfirecrawlmarkdownweb scrapingchrome extensionai tools

Cheap Firecrawl alternative for hobby RAG

A practical Firecrawl alternative workflow for hobby RAG using Web2MD, Crawl4AI, Jina Reader, Trafilatura, Readability, and Playwright.

2026-05-178 min read

firecrawl alternativerag pipelineweb scrapingai workflowmcp serverclaude codecursoranti-botobsidian

Firecrawl Costs Too Much for Hobby RAG — Here's a $9 Alternative That Uses Your Real Browser

Firecrawl Extract is great, but $188/mo is wrong for solo RAG. Flip the architecture: extract inside Chrome with your session. Web2MD does it for $9.

2026-05-077 min read

RAG pipeline preprocessingweb data for RAGRAG input qualityLangChainLlamaIndexvector databaseembedding qualityweb scrapingmarkdownAI engineering

RAG Pipeline Preprocessing: Why Web Data Quality Determines Everything

Most RAG pipelines fail on dirty input data, not weak LLMs. Deep-dive on preprocessing: crawling, cleaning, chunking, embedding — with Python and benchmarks.

2026-04-0417 min read

web scrapingno-codeaidata extractionautomation

Web Scraping for AI Without Writing a Single Line of Code

You don't need Python or BeautifulSoup to extract web data for AI. How no-code tools like Web2MD make web scraping accessible from marketers to researchers.

2026-02-107 min read