# ------------------------------------------------------------- # APENSIA ROBOTS.TXT - VERSION 3.0 (MARCH 2026) # ------------------------------------------------------------- User-agent: * # 1. PRIORITY ALLOWS (Fixes GSC Blocked Error) Allow: /web-development.html?city= Allow: /services-in-city.html?city= Allow: /apensia/political-pr/index.php?loc= Allow: /apensia/seo-services/ Allow: /apensia/blog/ Allow: /webstory/ Allow: / # 2. DISALLOWS (Crawl Budget Protection) User-agent: * Disallow: /*/SEO Services Disallow: /*?v=* Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /admin/ Disallow: /config/ Disallow: /tmp/ Disallow: /private/ Disallow: /cgi-bin/ Disallow: /beta/ Disallow: /test/ Disallow: /*-backup.html Disallow: /codes.txt # 3. PARAMETER BLOCKING (Only blocks tracking, not cities) Disallow: /*utm_* Disallow: /*ref=* Disallow: /*sid=* # 4. AI & SEARCH ENGINE OPTIMIZATION User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Google-Extended Allow: / # 5. SITEMAP INDEX (Cleaned List) Sitemap: https://apensia.in/sitemap.xml Sitemap: https://apensia.in/sitemap.php Sitemap: https://apensia.in/web-development-india-dynamic-sitemap.xml Sitemap: https://apensia.in/seo-global-sitemap.xml Sitemap: https://apensia.in/youtube-sitemap.xml # ------------------------------------------------------------- # End of File # -------------------------------------------------------------