taylorking.com
robots.txt

Robots Exclusion Standard data for taylorking.com

Resource Scan

Scan Details

Site Domain taylorking.com
Base Domain taylorking.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-23T01:11:09+00:00
Next Scan 2025-08-21T01:11:09+00:00

Last Successful Scan

Scanned2022-10-11T11:59:09+00:00
URL https://taylorking.com/robots.txt
Redirect https://www.taylorking.com/robots.txt
Redirect Domain www.taylorking.com
Redirect Base taylorking.com
Response IP 18.205.222.128, 52.202.168.65, 54.161.241.46, 54.237.133.81
Found Yes
Hash d309bf4062e6a7f26cc0d8b67182132997ff342be1dc5a99974e9c5d0d9d6ba3
SimHash 69148c12e291

Groups

*

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 10

adsbot-google

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 10

pinterest

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.taylorking.com/sitemap.xml
sitemap https://www.taylorking.com/sitemap.xml
sitemap https://www.taylorking.com/sitemap.xml
sitemap https://www.taylorking.com/sitemap.xml
sitemap https://www.taylorking.com/sitemap.xml
sitemap https://www.taylorking.com/sitemap.xml