Skip to main content

Purpose

Generates /llms/{product-slug}.txt files for products and deploys them to Vercel. These files provide detailed product information optimized for AI consumption.

Architecture

Pipeline Flow

This endpoint is the third step in a 3-step product pipeline:

File Structure

Example:

Source URL Filtering

The service only uses content from the product’s source_urls:
This ensures each product llms file contains only relevant content.

Scalability

This architecture scales to thousands of products:
  • Root llms.txt stays small (~3KB) with just links
  • Each product gets its own file (~1-2KB)
  • AI crawlers can fetch specific product files on-demand

Code Location