newlankasri.com
robots.txt

Robots Exclusion Standard data for newlankasri.com

Resource Scan

Scan Details

Site Domain newlankasri.com
Base Domain newlankasri.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-23T17:54:51+00:00
Next Scan 2024-11-21T17:54:51+00:00

Last Successful Scan

Scanned2023-01-06T09:14:13+00:00
URL http://newlankasri.com/robots.txt
Domain IPs 13.33.88.102, 13.33.88.109, 13.33.88.59, 13.33.88.61
Response IP 13.33.88.102
Found Yes
Hash 83f3a3b82e5cb8eea93ff777d452b6ee395a0d137d76eefa72a43fb6fa2f8896
SimHash 5851e701695b

Groups

*

Rule Path
Disallow /whoops
Disallow /classic
Disallow /*redirect
Disallow /*recache
Disallow /*desktop
Disallow /tamil/n*
Disallow /about
Disallow /contact-us
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/

Comments

  • Disallow: /*? This is match ? anywhere in the URL