pilot.com
robots.txt

Robots Exclusion Standard data for pilot.com

Resource Scan

Scan Details

Site Domain pilot.com
Base Domain pilot.com
Scan Status Ok
Last Scan2025-07-20T22:01:24+00:00
Next Scan 2025-08-19T22:01:24+00:00

Last Scan

Scanned2025-07-20T22:01:24+00:00
URL https://pilot.com/robots.txt
Domain IPs 52.68.134.190, 54.238.67.66, 57.180.160.60
Response IP 13.203.125.58
Found Yes
Hash cf53acc14debdb279be4858d7ad09fccfb640260e040dec5c0ccc81c2d07db3d
SimHash 1a295d17551b

Groups

*

Rule Path
Disallow /partner
Disallow /partner/*
Disallow /offer
Disallow /offer/*
Disallow /bookkeeping-policies
Disallow /**/*.pdf$
Disallow /**/*.xlsx$

Other Records

Field Value
sitemap https://pilot.com/sitemap.xml