forbescentroamerica.com
robots.txt

Robots Exclusion Standard data for forbescentroamerica.com

Resource Scan

Scan Details

Site Domain forbescentroamerica.com
Base Domain forbescentroamerica.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan1/26/2025, 8:26:47 AM
Next Scan 4/26/2025, 8:26:47 AM

Last Successful Scan

Scanned1/4/2023, 9:40:00 AM
URL https://forbescentroamerica.com/robots.txt
Domain IPs 104.21.80.161, 172.67.151.119, 2606:4700:3030::6815:50a1, 2606:4700:3030::ac43:9777
Response IP 104.21.80.161
Found Yes
Hash 7cd5aaf20a1ac17ef49acf2538fd4cda760b13b3d3ba00d5b15096031591dc2f
SimHash 4318d073eb93

Groups

*

Rule Path
Allow /*
Disallow /search/
Disallow /api/

irlbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3600

Other Records

Field Value
sitemap https://forbescentroamerica.com/sitemap/sitemap.xml

Comments

  • www.robotstxt.org/
  • Refugees