viraljoe.com
robots.txt
Robots Exclusion Standard data for viraljoe.com
Resource Scan
Scan Details
Site Domain | viraljoe.com |
Base Domain | viraljoe.com |
Scan Status | Ok |
Last Scan | 2024-11-13T21:39:16+00:00 |
Next Scan | 2024-11-20T21:39:16+00:00 |
Last Scan
Scanned | 2024-11-13T21:39:16+00:00 |
URL | https://viraljoe.com/robots.txt |
Domain IPs | 35.215.100.60 |
Response IP | 35.215.100.60 |
Found | Yes |
Hash | 83d92a78ff7fa8a03a725a605755f393d2ec07b76b9690ec6da4c533da989a3f |
SimHash | 4e10fc54ae53 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/* |
Disallow | /login |
Disallow | /uploads/* |
Disallow | /support |
Disallow | /support |
Disallow | /privacy |
Disallow | /terms-conditions |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | http://infy-news.test/sitemap.xml |