airlineweekly.skift.com
robots.txt

Robots Exclusion Standard data for airlineweekly.skift.com

Resource Scan

Scan Details

Site Domain airlineweekly.skift.com
Base Domain skift.com
Scan Status Ok
Last Scan2024-06-28T11:23:47+00:00
Next Scan 2024-07-28T11:23:47+00:00

Last Scan

Scanned2024-06-28T11:23:47+00:00
URL https://airlineweekly.skift.com/robots.txt
Domain IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.21
Found Yes
Hash f8e51fb1e04bb712be94e7ec271ffcde66b91e108151ccc7905358c05d6f8382
SimHash 6b0d78408213

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow *.pdf

Other Records

Field Value
sitemap https://airlineweekly.com/sitemap_index.xml

Comments

  • www.robotstxt.org/
  • !
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449