airlineweekly.com
robots.txt

Robots Exclusion Standard data for airlineweekly.com

Resource Scan

Scan Details

Site Domain airlineweekly.com
Base Domain airlineweekly.com
Scan Status Ok
Last Scan2024-10-04T03:35:12+00:00
Next Scan 2024-10-18T03:35:12+00:00

Last Scan

Scanned2024-10-04T03:35:12+00:00
URL http://airlineweekly.com/robots.txt
Redirect http://airlineweekly.skift.com/robots.txt
Redirect Domain airlineweekly.skift.com
Redirect Base skift.com
Domain IPs 35.203.141.178
Redirect IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.20
Found Yes
Hash f8e51fb1e04bb712be94e7ec271ffcde66b91e108151ccc7905358c05d6f8382
SimHash 6b0d78408213

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow *.pdf

Other Records

Field Value
sitemap https://airlineweekly.com/sitemap_index.xml

Comments

  • www.robotstxt.org/
  • !
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449