licensed.contractors
robots.txt

Robots Exclusion Standard data for licensed.contractors

Resource Scan

Scan Details

Site Domain licensed.contractors
Base Domain licensed.contractors
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-28T17:21:28+00:00
Next Scan 2026-02-26T17:21:28+00:00

Last Successful Scan

Scanned2025-02-02T14:43:21+00:00
URL https://licensed.contractors/robots.txt
Redirect https://www.licensed.contractors/robots.txt
Redirect Domain www.licensed.contractors
Redirect Base licensed.contractors
Domain IPs 172.66.41.13, 172.66.42.243, 2606:4700:3108::ac42:290d, 2606:4700:3108::ac42:2af3
Redirect IPs 172.66.41.13, 172.66.42.243, 2606:4700:3108::ac42:290d, 2606:4700:3108::ac42:2af3
Response IP 172.66.41.13
Found Yes
Hash 41942768a89533e6b459862e3ec79be5d5f8108fb3dcce9111b9a8b1014d8743
SimHash 3515d540e151

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /*.pdf$
Disallow /downloads/