# ============================================================================== # ViaNet Media Official robots.txt # Optimized for Google, Bing, Apple Search and Generative AI Search Engines # ============================================================================== # Search Engine Crawlers User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Applebot Allow: / User-agent: YandexBot Allow: / User-agent: Baiduspider Allow: / User-agent: DuckDuckBot Allow: / # Generative AI Answer Engines & Search Citability (ChatGPT Search, Perplexity, Claude Search) User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Claude-SearchBot Allow: / # Restrict Unverified Mass Web Scraping User-agent: CCBot Disallow: / # Default Rules User-agent: * Allow: / Allow: /music Allow: /music/* Disallow: /auth/ Disallow: /admin/ Disallow: /system/ Disallow: /application/ # LLMs Text Directives (Generative Engine Optimization) # https://vianetmedia.com/llms.txt # Canonical Sitemaps Sitemap: https://vianetmedia.com/sitemap.xml Sitemap: https://vianetmedia.com/music/sitemap.xml