Internal Service — This is not an HTTP endpoint. It’s called directly by the generate-all orchestrator.
Purpose
Generates /llms/{product-slug}.txt files for discovered products and deploys them to Vercel.
Runs in GROUP 3b (parallel with GROUP 3a product prompts, after GROUP 2b discover products).
Shared Service
This task uses the shared generate_product_llms_txt service:
src/app/shared/products/generate_llms_txt.py
- Onboarding (this task - GROUP 3b)
- Cron (
discover-products-from-changes)
- Cron (
generate-product-llms-txt standalone endpoint)
Function Signature
async def run_generate_product_llms_txt(
url: str,
org_slug: str,
business_name: str,
products: list,
pages: list
) -> StepResult
Parameters
| Parameter | Type | Description |
|---|
url | str | The business website URL |
org_slug | str | The Clerk organization slug |
business_name | str | The business name |
products | list | Products from GROUP 2b [] |
pages | list | Pre-scraped pages from GROUP 1a |
Returns
{
"name": "generate_product_llms_txt",
"status": "success",
"data": {
"files_generated": 3,
"files_deployed": 3,
"products": ["Product A", "Product B", "Product C"]
}
}
Execution Flow
Product LLMs Architecture
| File | Location | In Sitemap | In index.js |
|---|
| Root llms.txt | /llms.txt | Yes | Yes |
| Product llms | /llms/{product-slug}.txt | Yes | No |
- Root
llms.txt stays small (~3KB)
- Each product gets its own file (~1-2KB)
- Product files are fetched on-demand for boosted page generation
Code Location
src/app/shared/products/
├── __init__.py
├── discover.py # Shared discover_products service
└── generate_llms_txt.py # Shared generate_product_llms_txt service
src/app/apis/onboarding/generate_all/tasks/
└── product_llms.py # run_generate_product_llms_txt task wrapper
Error Handling
{
"name": "generate_product_llms_txt",
"status": "error",
"error": "AI site project_name not found"
}
