github.careers
robots.txt

Robots Exclusion Standard data for github.careers

Resource Scan

Scan Details

Site Domain github.careers
Base Domain github.careers
Scan Status Ok
Last Scan2025-11-01T19:34:29+00:00
Next Scan 2025-12-01T19:34:29+00:00

Last Scan

Scanned2025-11-01T19:34:29+00:00
URL https://github.careers/robots.txt
Redirect https://www.github.careers/robots.txt
Redirect Domain www.github.careers
Redirect Base github.careers
Domain IPs 3.226.73.193, 34.233.4.33, 35.153.85.206
Redirect IPs 3.86.136.190, 34.192.10.79, 54.86.180.29
Response IP 3.86.136.190
Found Yes
Hash 3df3aa523e1ace5efb8f2343e347ecbdb13834a47d723d3bb90c540c34429d13
SimHash 69189055c731

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap http://www.github.careers/sitemap.xml