User-agent: * Disallow: /examples/ Disallow: /forum_old/ Disallow: /?* Disallow: /forum/ Disallow: /forums/ Sitemap: https://ricard.dev/sitemap_index.xml # Dark Visitors Robots.txt # AI Data Scraper # https://darkvisitors.com/agents/anthropic-ai User-agent: anthropic-ai Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/bytespider User-agent: Bytespider Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/ccbot User-agent: CCBot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/diffbot User-agent: Diffbot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/facebookbot User-agent: FacebookBot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/google-extended User-agent: Google-Extended Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/gptbot User-agent: GPTBot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/omgili User-agent: omgili Disallow: /