theabroadguide.com
robots.txt

Robots Exclusion Standard data for theabroadguide.com

Resource Scan

Scan Details

Site Domain theabroadguide.com
Base Domain theabroadguide.com
Scan Status Ok
Last Scan2024-09-19T09:17:25+00:00
Next Scan 2024-09-26T09:17:25+00:00

Last Scan

Scanned2024-09-19T09:17:25+00:00
URL https://theabroadguide.com/robots.txt
Domain IPs 107.180.51.102
Response IP 107.180.51.102
Found Yes
Hash 36493619fd00a13aa7d587381bfac539c1d5d5ebb23a8b30b1772632e9a922b0
SimHash c8400a80f593

Groups

scrapy

Rule Path
Allow /
Disallow /wp-content/uploads/wpo-plugins-tables-list.json

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://theabroadguide.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK