eagent.com
robots.txt

Robots Exclusion Standard data for eagent.com

Resource Scan

Scan Details

Site Domain eagent.com
Base Domain eagent.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-29T20:03:18+00:00
Next Scan 2025-11-27T20:03:18+00:00

Last Successful Scan

Scanned2024-02-28T11:39:54+00:00
URL https://eagent.com/robots.txt
Redirect https://www.eagent.com/robots.txt
Redirect Domain www.eagent.com
Redirect Base eagent.com
Domain IPs 104.17.235.232, 104.17.236.232, 104.17.237.232, 104.17.238.232, 104.17.239.232, 2606:4700::6811:ebe8, 2606:4700::6811:ece8, 2606:4700::6811:ede8, 2606:4700::6811:eee8, 2606:4700::6811:efe8
Redirect IPs 104.17.235.232, 104.17.236.232, 104.17.237.232, 104.17.238.232, 104.17.239.232, 2606:4700::6811:ebe8, 2606:4700::6811:ece8, 2606:4700::6811:ede8, 2606:4700::6811:eee8, 2606:4700::6811:efe8
Response IP 104.17.236.232
Found Yes
Hash 7078fe19d727354397f2c6fa680474a631d73323bdfb9f1882fc24938c0e3447
SimHash 4a61c4348291

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /cgi-bin/
Disallow /emails_kvarea/
Disallow /index.php?similar=1
Disallow /language.php
Disallow /mobilefirst/
Disallow /print-flyer.php
Disallow /private_kvarea/
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.eagent.com/sitemap-index.xml