# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: # User-Agent: * # Disallow: / User-agent: ClaudeBot User-agent: GPTBot User-agent: SemrushBot User-agent: AmazonBot User-agent: PetalBot User-agent: Bytespider User-agent: DataForSeoBot User-agent: serpstatbot Disallow: / User-agent: * Crawl-delay: 10 Disallow: /en/cart Disallow: /es/cart Disallow: /en/checkout Disallow: /es/checkout Disallow: /en/login Disallow: /es/login Disallow: /en/orders Disallow: /es/orders Disallow: /en/signup Disallow: /es/signup Disallow: /*?search Disallow: /*&search