# www.lymon.es - Sistema de Pedidos y Pagos con QR para Restaurantes # Última actualización: 2026-11-21 # ============================================ # CONFIGURACIÓN PRINCIPAL # ============================================ User-agent: * Allow: / Crawl-delay: 1 # Bloquear rutas administrativas y API Disallow: /admin/ Disallow: /api/ Disallow: /dashboard/ Disallow: /private/ Disallow: /404 Disallow: /500 Disallow: /gracias Disallow: /thank-you Disallow: /confirmacion # Las URL antiguas (/contact, /privacy-policy, /about...) NO se bloquean: son # redirecciones a la página canónica (meta refresh, con canonical y noindex). # Bloquearlas impedía seguir el salto, así que un agente que probaba # /privacy-policy o /about —lo que hacen para comprobar que una empresa es # real— se quedaba sin respuesta. La redirección ya evita el contenido # duplicado; robots.txt no hacía falta. # Bloquear parámetros de tracking (evitar contenido duplicado) Disallow: /*?*utm_source= Disallow: /*?*utm_medium= Disallow: /*?*utm_campaign= Disallow: /*?*fbclid= Disallow: /*?*gclid= Disallow: /*?token= Disallow: /*?session= Disallow: /buscar? Disallow: /search? # ============================================ # GOOGLEBOT - OPTIMIZACIÓN # ============================================ User-agent: Googlebot Allow: / Crawl-delay: 0 Disallow: /admin/ Disallow: /api/ Disallow: /dashboard/ Disallow: /*?*utm_source= Disallow: /*?*fbclid= User-agent: Googlebot-Image Allow: / Allow: /images/ Allow: /*.webp Allow: /*.jpg Allow: /*.png Allow: /*.svg User-agent: Googlebot-Mobile Allow: / Crawl-delay: 0 Disallow: /admin/ Disallow: /api/ User-agent: Mediapartners-Google Allow: / User-agent: AdsBot-Google Allow: / Disallow: /admin/ Disallow: /api/ # ============================================ # OTROS BUSCADORES # ============================================ User-agent: Bingbot Allow: / Crawl-delay: 1 Disallow: /admin/ Disallow: /api/ User-agent: DuckDuckBot Allow: / Crawl-delay: 1 Disallow: /admin/ Disallow: /api/ User-agent: Baiduspider Crawl-delay: 5 Disallow: /admin/ Disallow: /api/ User-agent: Yandex Crawl-delay: 3 Disallow: /admin/ Disallow: /api/ # ============================================ # BOTS DE IA - PERMITIDO (GEO: visibilidad en LLMs) # ============================================ User-agent: GPTBot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /dashboard/ User-agent: OAI-SearchBot Allow: / Disallow: /admin/ Disallow: /api/ User-agent: ChatGPT-User Allow: / Disallow: /admin/ Disallow: /api/ User-agent: Google-Extended Allow: / Disallow: /admin/ Disallow: /api/ User-agent: anthropic-ai Allow: / Disallow: /admin/ Disallow: /api/ User-agent: ClaudeBot Allow: / Disallow: /admin/ Disallow: /api/ User-agent: CCBot Allow: / Crawl-delay: 2 Disallow: /admin/ Disallow: /api/ User-agent: PerplexityBot Allow: / Disallow: /admin/ Disallow: /api/ User-agent: cohere-ai Allow: / Disallow: /admin/ Disallow: /api/ User-agent: Applebot-Extended Allow: / Disallow: /admin/ Disallow: /api/ User-agent: YouBot Allow: / Disallow: /admin/ Disallow: /api/ User-agent: Meta-ExternalAgent Allow: / Disallow: /admin/ Disallow: /api/ # ============================================ # BOTS DE SCRAPING - BLOQUEO TOTAL # ============================================ User-agent: omgilibot Disallow: / # ============================================ # REDES SOCIALES - PERMITIR SIEMPRE # ============================================ User-agent: facebookexternalhit Allow: / User-agent: Facebot Allow: / User-agent: Instagram Allow: / User-agent: LinkedInBot Allow: / User-agent: Twitterbot Allow: / User-agent: WhatsApp Allow: / User-agent: TelegramBot Allow: / User-agent: Pinterest Allow: / User-agent: Slackbot Allow: / User-agent: Discordbot Allow: / # ============================================ # SEO TOOLS - CONTROL DE RECURSOS # ============================================ User-agent: AhrefsBot Crawl-delay: 10 Disallow: /admin/ Disallow: /api/ User-agent: SemrushBot Crawl-delay: 10 Disallow: /admin/ Disallow: /api/ User-agent: MJ12bot Crawl-delay: 10 Disallow: /admin/ Disallow: /api/ User-agent: rogerbot User-agent: dotbot Crawl-delay: 10 Disallow: /admin/ # ============================================ # BOTS MALICIOSOS - BLOQUEO TOTAL # ============================================ User-agent: Scrapy Disallow: / User-agent: PetalBot Disallow: / User-agent: MegaIndex Disallow: / User-agent: BLEXBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: SentiBot Disallow: / # ============================================ # AGENTES: DÓNDE EMPEZAR # ============================================ # Resumen del producto y sus páginas: https://www.lymon.es/llms.txt # Cuándo recurrir a Lymon y cuándo no: https://www.lymon.es/agent-instructions.md # Cualquier página se sirve también en Markdown: añade .md a la ruta # (/pedir-y-pagar.md). Cada página lo anuncia con . # ============================================ # SITEMAPS - ✅ CRÍTICO: CON WWW # ============================================ Sitemap: https://www.lymon.es/sitemap-index.xml Sitemap: https://www.lymon.es/sitemap-0.xml