flyscoot.com
robots.txt

Robots Exclusion Standard data for flyscoot.com

Resource Scan

Scan Details

Site Domain flyscoot.com
Base Domain flyscoot.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-10-10T23:04:08+00:00
Next Scan 2026-01-08T23:04:08+00:00

Last Successful Scan

Scanned2025-03-08T22:09:04+00:00
URL https://flyscoot.com/robots.txt
Redirect https://www.flyscoot.com/robots.txt
Redirect Domain www.flyscoot.com
Redirect Base flyscoot.com
Domain IPs 45.60.80.25, 45.60.83.25
Redirect IPs 45.60.83.25
Response IP 45.60.83.25
Found Yes
Hash e5a43e8368331b5598ee307ebe971fa95003bc701c3ac4f7400a3874da10682e
SimHash 1e081d502790

Groups

*

Rule Path
Disallow /assets/
Disallow /ajax/
Disallow /sitefinity
Disallow /partners/
Disallow /en/header-partner
Disallow /zh/header-partner
Disallow /zhtw/header-partner
Disallow /id/header-partner
Disallow /th/header-partner
Disallow /jp/header-partner
Disallow /ko/header-partner
Disallow /vi/header-partner
Disallow /en/footer-partner
Disallow /zh/footer-partner
Disallow /zhtw/footer-partner
Disallow /id/footer-partner
Disallow /th/footer-partner
Disallow /jp/footer-partner
Disallow /ko/footer-partner
Disallow /vi/footer-partner
Disallow /en/404
Disallow /zh/404
Disallow /zhtw/404
Disallow /id/404
Disallow /th/404
Disallow /jp/404
Disallow /ko/404
Disallow /vi/404

Other Records

Field Value
sitemap https://www.flyscoot.com/sitemap/sitemap-index.xml

Comments

  • robots.txt file for http://www.flyscoot.com/
  • ver. 29092021
  • Crawlers Setup
  • Crawl-delay: 10
  • Directories
  • Paths (clean URLs)
  • Paths (discontinued URLs)