luxseeker.com
robots.txt

Robots Exclusion Standard data for luxseeker.com

Resource Scan

Scan Details

Site Domain luxseeker.com
Base Domain luxseeker.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-16T23:42:36+00:00
Next Scan 2024-08-14T23:42:36+00:00

Last Successful Scan

Scanned2023-01-27T07:06:04+00:00
URL https://luxseeker.com/robots.txt
Domain IPs 104.26.0.156, 104.26.1.156, 172.67.71.111, 2606:4700:20::681a:19c, 2606:4700:20::681a:9c, 2606:4700:20::ac43:476f
Response IP 172.67.71.111
Found Yes
Hash 7783bc798ee73bc5fe55aa1728c3dcc405918e065b67381f172afd63c2f461f7
SimHash 4f08d4d04731

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://luxseeker.com/index.php/sitemap.xml