Skip to content
mistakes.show
793Kissues on 68,769 sites
mistakes.show
Get in touch
  1. Home
  2. Mistakes
  3. Invalid lines in robots.txt
SEOMinor

Invalid lines in robots.txt

Unknown directives are ignored, so rules may not work as intended.

2%of Global websites

By market

  1. Global2%
  2. United Kingdom1.9%
  3. Netherlands1.4%
  4. Italy1.4%
  5. Spain1.9%
  6. Japan0.7%
  7. Latin America1.2%

Examples

Popular sites where we saw this on the homepage (at crawl time).

wikipedia.orgtheguardian.comforter.comalidns.comicanhazip.comlaunchpad.netcheckpoint.comnvidia.comadsafeprotected.comcapcut.comunesco.orgnintendo.com

How to fix

  1. 1Fix typos and unsupported directives; test with our robots.txt tester.
robots.txt tester

Related mistakes

Our crawler: 68,769 sites · Global · updated Oct 23, 2026 · Methodology

Found mistakes on your site?

We can fix them in one sprint. Reply within one business day.

Get in touchServices