webadroit.in
robots.txt
Robots Exclusion Standard data for webadroit.in
Resource Scan
Scan Details
Site Domain | webadroit.in |
Base Domain | webadroit.in |
Scan Status | Ok |
Last Scan | 2024-10-01T06:30:03+00:00 |
Next Scan | 2024-10-08T06:30:03+00:00 |
Last Scan
Scanned | 2024-10-01T06:30:03+00:00 |
URL | https://webadroit.in/robots.txt |
Domain IPs | 104.21.3.152, 172.67.130.228, 2606:4700:3030::ac43:82e4, 2606:4700:3035::6815:398 |
Response IP | 104.21.3.152 |
Found | Yes |
Hash | a40d3516fda52d05114e212519f515fa42b5c8c04796e9fea4ba1050a0c9c26c |
SimHash | ca085540e909 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Disallow | /linkout/ |
Disallow | /recommended/ |
Disallow | /comments/feed/ |
Disallow | /trackback/ |
Disallow | /index.php |
Disallow | /xmlrpc.php |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
*
Rule | Path |
---|---|
Disallow | /wp-content/uploads/wp-import-export-lite/ |
Other Records
Field | Value |
---|---|
sitemap | https://guardianlv.com/sitemap_index.xml |
Warnings
- 2 invalid lines.
Comments