api.github.com
robots.txt

Robots Exclusion Standard data for api.github.com

Resource Scan

Scan Details

Site Domain api.github.com
Base Domain github.com
Scan Status Ok
Last Scan2024-06-03T11:21:26+00:00
Next Scan 2024-06-17T11:21:26+00:00

Last Scan

Scanned2024-06-03T11:21:26+00:00
URL https://api.github.com/robots.txt
Domain IPs 20.205.243.168
Response IP 20.205.243.168
Found Yes
Hash 4715e7c130cb5b4136bc1e0e756a03546e003e13af76cd4c6b00db610ff005f4
SimHash c83e7232dd11

Groups

*

Rule Path
Allow /
Disallow

Comments

  • If you would like to crawl GitHub contact us via https://support.github.com?tags=dotcom-robots
  • We also provide an extensive API: https://docs.github.com