fa-th-main.com
robots.txt

Robots Exclusion Standard data for fa-th-main.com

Resource Scan

Scan Details

Site Domain fa-th-main.com
Base Domain fa-th-main.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-05-29T23:33:31+00:00
Next Scan 2025-08-27T23:33:31+00:00

Last Successful Scan

Scanned2025-01-07T23:28:47+00:00
URL https://fa-th-main.com/robots.txt
Domain IPs 103.230.123.165, 103.86.50.84, 116.206.124.47
Response IP 103.86.50.84
Found Yes
Hash c833869022ba7d3194e53fefa9ca67fc1742459a20b43843e3219fdc82a7ab3b
SimHash 4815d800e390

Groups

googlebot

Rule Path
Disallow /

googlebot
adsbot-google

Rule Path
Disallow /

*

Rule Path
Disallow /

Comments

  • Example 1: Block only Googlebot
  • Example 2: Block Googlebot and Adsbot
  • Example 3: Block all crawlers except AdsBot (AdsBot crawlers must be named explicitly)