Log In Sign Up

catamana.com
robots.txt

Robots Exclusion Standard data for catamana.com

Resource Scan

Scan Details

Site Domain catamana.com
Base Domain catamana.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-08T18:44:27+00:00
Next Scan 2024-12-07T18:44:27+00:00

Last Successful Scan

Scanned2022-10-22T10:44:44+00:00
URL https://www.catamana.com/robots.txt
Response IP 13.33.33.120, 13.33.33.124, 13.33.33.12, 13.33.33.31
Found Yes
Hash 477939caec131cd7494ad61295a997fa057c446e8d8f84fc3d1a1ae22e65652a
SimHash 4c74997a2353

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Disallow /
Back to top

Comments

  • Allow all user agents.
  • User agent "Googlebot" should not crawl the `http://example.com/nogooglebot/` folder or any of its subdirectories.
Back to top