bssnews.net
robots.txt
Robots Exclusion Standard data for bssnews.net
Resource Scan
Scan Details
Site Domain | bssnews.net |
Base Domain | bssnews.net |
Scan Status | Ok |
Last Scan | 2024-09-16T05:14:46+00:00 |
Next Scan | 2024-10-16T05:14:46+00:00 |
Last Scan
Scanned | 2024-09-16T05:14:46+00:00 |
URL | https://bssnews.net/robots.txt |
Domain IPs | 104.26.12.233, 104.26.13.233, 172.67.68.129, 2606:4700:20::681a:ce9, 2606:4700:20::681a:de9, 2606:4700:20::ac43:4481 |
Response IP | 172.67.68.129 |
Found | Yes |
Hash | 109bad8783f6730bd2cacdd29f501d01898a432499b524df31e4767684c2ca38 |
SimHash | 69150456c693 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /cgi-bin/ |
Disallow | /admin/ |
Disallow | /cgi-bin/* |
Disallow | /admin/* |
Disallow |
Other Records
Field | Value |
---|---|
sitemap | http://bssnews.net/sitemap.xml |