202.fm
robots.txt

Robots Exclusion Standard data for 202.fm

Resource Scan

Scan Details

Site Domain 202.fm
Base Domain 202.fm
Scan Status Ok
Last Scan2024-09-29T03:35:10+00:00
Next Scan 2024-10-06T03:35:10+00:00

Last Scan

Scanned2024-09-29T03:35:10+00:00
URL http://202.fm/robots.txt
Domain IPs 216.235.90.242
Response IP 216.235.90.242
Found Yes
Hash 378190b25c3059a0e8a9d6922e871ab0bb951800b07b60329237848a6ac3505d
SimHash 68111d039716

Groups

*

Rule Path Comment
Disallow /ads/ - search engine crawlers shouldnt be able to see any of the ads
Disallow /a/ - search engine crawlers shouldnt be able to see any of the ads

Comments

  • This is an example to disallow search engines to see a particular file a.k.a: iframe
  • Disallow: /file/file.html