# /robots.txt for https://www.privatecommunities.com/ # comments to webmaster@privatecommunities.com Sitemap: https://www.privatecommunities.com/sitemapindex.xml # =============================== # OpenAI / ChatGPT Crawlers # =============================== # Wildcard to cover future ChatGPT variants User-agent: ChatGPT* Allow: / User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / # =============================== # Anthropic / Claude AI Crawlers # =============================== # Wildcard to cover future Claude variants User-agent: Claude* Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: anthropic-ai Allow: / # =============================== # Perplexity AI Crawlers # =============================== # Wildcard to cover future Perplexity variants User-agent: Perplexity* Allow: / User-agent: PerplexityBot Allow: / User-agent: PerplexityBot/1.0 Allow: / # =============================== # Google Crawlers # =============================== User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-Video Allow: / User-agent: Googlebot-News Allow: / User-agent: Google-Extended Allow: / User-agent: AdsBot-Google Allow: / User-agent: Google-Favicon Allow: / User-agent: Feedfetcher-Google Allow: / User-agent: Google-Site-Verification Allow: / User-agent: Google-Structured-Data-Testing-Tool Allow: / # =============================== # Bing / Microsoft Crawlers # =============================== User-agent: Bingbot Allow: / User-agent: BingPreview Allow: / User-agent: BingAI Allow: / User-agent: Microsoft-Extended Allow: / User-agent: AdIdxBot Allow: / User-agent: AdIdxSMBot Allow: / User-agent: BingImageBot Allow: / User-agent: BingVideoBot Allow: / User-agent: BingFaviconBot Allow: / # =============================== # Other Crawlers # =============================== User-agent: CCBot Allow: / User-agent: CCBot* Allow: / # =============================== # General access # =============================== User-agent: * Allow: /