my-flightone.com
robots.txt

Robots Exclusion Standard data for my-flightone.com

Resource Scan

Scan Details

Site Domain my-flightone.com
Base Domain my-flightone.com
Scan Status Ok
Last Scan2025-10-04T12:58:25+00:00
Next Scan 2025-11-03T12:58:25+00:00

Last Scan

Scanned2025-10-04T12:58:25+00:00
URL https://my-flightone.com/robots.txt
Domain IPs 50.87.232.115
Response IP 50.87.232.115
Found Yes
Hash 5f7eb0b4ec16abf07f5789a8ead09b518f8ccee28d07775f1abd47dfbaef30cb
SimHash 48088890a122

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://my-flightone.com/sitemap_index.xml

Comments

  • Allow Scrapy (optional - remove if not needed)
  • Sitemap
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK