infoaboutlawyers.com
robots.txt

Robots Exclusion Standard data for infoaboutlawyers.com

Resource Scan

Scan Details

Site Domain infoaboutlawyers.com
Base Domain infoaboutlawyers.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-21T21:53:56+00:00
Next Scan 2024-12-20T21:53:56+00:00

Last Successful Scan

Scanned2022-12-02T02:48:54+00:00
URL http://infoaboutlawyers.com/robots.txt
Domain IPs 167.86.91.58
Response IP 167.86.91.58
Found Yes
Hash c8c1baae22dd11c3288414da2b1a0841d8149b5d486706579ae867e3bee24557
SimHash 6708944143b3

Groups

*

Rule Path
Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://infoaboutlawyers.com/sitemap.xml

Warnings

  • `host` is not a known field.