Log In Sign Up

afcoe.org
robots.txt

Robots Exclusion Standard data for afcoe.org

Resource Scan

Scan Details

Site Domain afcoe.org
Base Domain afcoe.org
Scan Status Ok
Last Scan2024-10-29T23:36:54+00:00
Next Scan 2024-11-28T23:36:54+00:00

Last Scan

Scanned2024-10-29T23:36:54+00:00
URL https://afcoe.org/robots.txt
Redirect https://www.afcoe.org/robots.txt
Redirect Domain www.afcoe.org
Redirect Base afcoe.org
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Redirect IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 151.101.66.132
Found Yes
Hash eeadef6128bce3a334549679af24bb9ead649618c2839d9e516f262a1a330140
SimHash a85ccd43cfd7

Groups

*

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://www.afcoe.org/SiteMap.aspx
Back to top

Comments

  • Disallow: Any empty value, indicates that all URLs can be retrieved. At least one Disallow field needs to be present in a record.
  • If the value is '*', the record describes the default access policy for any robot that has not matched any of the other records.
Back to top