portangelesclinicare.com
robots.txt

Robots Exclusion Standard data for portangelesclinicare.com

Resource Scan

Scan Details

Site Domain portangelesclinicare.com
Base Domain portangelesclinicare.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-05T20:19:49+00:00
Next Scan 2025-01-03T20:19:49+00:00

Last Successful Scan

Scanned2022-07-18T09:29:10+00:00
URL https://portangelesclinicare.com/robots.txt
Redirect https://www.portangelesclinicare.com/robots.txt
Redirect Domain www.portangelesclinicare.com
Redirect Base portangelesclinicare.com
Response IP 172.67.150.168
Found Yes
Hash 43dd31815ed5a456acafa5e52b0c52095f465ab445b1c2abcba327d17eb55f4d
SimHash 414ddec245c0

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

njuicebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

flaxcrawler

Rule Path
Disallow /

bittorrent

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

dispatch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.portangelesclinicare.com/sitemap.xml

Warnings

  • `host` is not a known field.