Skip to main content

Internal Services: IndexNow + GSC Submission

After Step 2 of domain connection completes, a background orchestrator handles Google verification and search engine submission:
  1. Google Verification - Polls TXT record verification (10s × 12 = 2 min)
  2. IndexNow - Notifies Bing, Yandex, and other IndexNow-compatible engines
  3. Google Search Console - Submits sitemap (only if domain is verified)

Purpose

These tasks ensure search engines are immediately notified about the AI site after the proxy is connected. This is one of only TWO places where search engine submission happens:
  1. Here - One-time after domain connection (Step 2)
  2. BATCH 3 in daily cron - After new content is deployed

Why Poll Google Verification in Step 2?

The Google TXT record is added during Step 1 (alongside the SSL TXT record), but we verify it in Step 2 because:
  1. DNS Propagation: TXT records need time to propagate globally
  2. More Time: By Step 2, the record has had time to propagate
  3. Resilience: Polling handles slow DNS gracefully (up to 2 minutes)
  4. Non-blocking: User doesn’t wait - it runs in background

Function Signatures

Parameters

Google Verify + Submit Orchestrator

IndexNow

GSC

URLs Submitted (IndexNow)

The function fetches sitemap.xml from the deployed AI site, parses all <loc> URLs, replaces the AI site domain with the customer’s source domain, and submits to IndexNow.

Execution Flow

Polling Details

Dependencies

  • src/app/shared/google_search_console.py - verify_domain(), add_to_search_console(), submit_sitemap()
  • src/app/shared/indexnow.py - submit_urls_to_indexnow()

Code Location