# Joy Juice - robots.txt # Website: https://joyjuice.co # Jus de fruits frais artisanaux - Alpes-Maritimes (06) # Updated: November 2026 # # Un robot nommé dans un groupe ignore le groupe "User-agent: *" : # chaque groupe nommé répète les exclusions qui valent pour lui. # ============================================================================= # GOOGLE CRAWLERS # Googlebot doit avoir les mêmes Disallow que User-agent: * # sinon il crawle tout (section spécifique override la générale) # Ref: https://developers.google.com/search/docs/crawling-indexing/robots/intro # ============================================================================= User-agent: Googlebot Allow: / Allow: /shop Allow: /blog Allow: /web/image/ Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /website/info/ Disallow: /website/translations Disallow: /*?order= Disallow: /*?category= Disallow: /*?filter= Disallow: /*?attrib= Disallow: /*?search= Disallow: /*?page= Disallow: /shop/cart Disallow: /shop/checkout Disallow: /shop/payment Disallow: /shop/confirmation Disallow: /shop/change_pricelist/ Disallow: /web/signup # Google Images - tout autorisé (images = visibilité) User-agent: Googlebot-image Disallow: # Google Merchant Center - tout autorisé (commerce) User-agent: Storebot-Google Disallow: # Google Search Console - tout autorisé (inspection) User-agent: Google-InspectionTool Disallow: # ============================================================================= # GENERAL CRAWLERS (Bing, etc.) # ============================================================================= User-agent: * Allow: / Allow: /shop Allow: /blog Allow: /web/image/ Allow: /joy-club Allow: /professionnels Allow: /notre-histoire Allow: /faq Allow: /quiz-vos-gouts Allow: /contactus # Disallow internal/admin pages (SAUF images) Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /website/info/ Disallow: /website/translations # Disallow duplicate content (filters, sorting, search) Disallow: /*?order= Disallow: /*?category= Disallow: /*?filter= Disallow: /*?attrib= Disallow: /*?search= Disallow: /*?page= Disallow: /shop/cart Disallow: /shop/checkout Disallow: /shop/payment Disallow: /shop/confirmation Disallow: /shop/change_pricelist/ Disallow: /web/signup # ============================================================================= # AI CRAWLERS - ALLOWED (for AI search visibility) # /web/ n'est plus bloqué en entier : seules les mêmes routes /web/ que "*" # (login, session, database, signup), pour laisser /web/image/ aux robots IA. # ============================================================================= # OpenAI GPTBot (ChatGPT) - ALLOWED for search User-agent: GPTBot Allow: / Allow: /web/image/ Allow: /llms.txt Allow: /llms-full.txt Allow: /.well-known/ai-plugin.json Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /web/signup Disallow: /shop/cart Disallow: /shop/checkout # OpenAI ChatGPT-User (live browsing) - ALLOWED User-agent: ChatGPT-User Allow: / Allow: /web/image/ Allow: /llms.txt Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /web/signup # Anthropic ClaudeBot - ALLOWED User-agent: ClaudeBot Allow: / Allow: /web/image/ Allow: /llms.txt Allow: /llms-full.txt Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /web/signup # Perplexity - ALLOWED (AI search engine with attribution) User-agent: PerplexityBot Allow: / Allow: /web/image/ Allow: /llms.txt Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /web/signup # Google Gemini (AI Overviews) - ALLOWED # Garder ce jeton nommé : éligibilité à l'ancrage Gemini (Google, 30/10/2026) User-agent: Google-Extended Allow: / Allow: /web/image/ Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /web/signup # Apple AI (Siri, etc.) - ALLOWED User-agent: Applebot-Extended Allow: / Allow: /web/image/ Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /web/signup # Meta AI - ALLOWED User-agent: meta-externalagent Allow: / Allow: /web/image/ Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /web/signup # ============================================================================= # AI SEARCH & USER-TRIGGERED FETCHERS - ALLOWED (citations, pas d'entraînement) # OpenAI (recherche ChatGPT), Anthropic (recherche et lecture à la demande), # Perplexity (lecture à la demande), Mistral (index et lecture à la demande), # Meta (recherche Meta AI) # ============================================================================= User-agent: OAI-SearchBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: Perplexity-User User-agent: MistralAI-Index User-agent: MistralAI-User User-agent: meta-webindexer Allow: / Allow: /web/image/ Allow: /llms.txt Allow: /llms-full.txt Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /web/signup # ============================================================================= # AI TRAINING CRAWLERS - ALLOWED (pour être dans la mémoire des LLMs) # ============================================================================= # Common Crawl (training data) - ALLOWED pour visibilité maximale User-agent: CCBot Allow: / Allow: /web/image/ Allow: /llms.txt Allow: /llms-full.txt Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /web/signup # Bytedance (TikTok AI) - ALLOWED User-agent: Bytespider Allow: / Allow: /web/image/ Allow: /llms.txt Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /web/signup # Cohere AI - ALLOWED User-agent: cohere-ai Allow: / Allow: /web/image/ Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /web/signup # AI2 (Allen Institute) - ALLOWED User-agent: AI2Bot Allow: / Allow: /web/image/ Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /web/signup # Amazon (Alexa) - ALLOWED User-agent: Amazonbot Allow: / Allow: /web/image/ Disallow: /my/ Disallow: /web/login Disallow: /web/session/ Disallow: /web/database/ Disallow: /web/signup # ============================================================================= # SITEMAPS & SPECIAL FILES # ============================================================================= Sitemap: https://joyjuice.co/sitemap.xml # LLM-specific content (llms.txt standard) # See: https://llmstxt.org/ # llms.txt: https://joyjuice.co/llms.txt # llms-full.txt: https://joyjuice.co/llms-full.txt # AI Plugin manifest (ChatGPT plugins) # ai-plugin.json: https://joyjuice.co/.well-known/ai-plugin.json