bignews1.com
robots.txt
Robots Exclusion Standard data for bignews1.com
Resource Scan
Scan Details
Site Domain | bignews1.com |
Base Domain | bignews1.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-06-15T06:20:55+00:00 |
Next Scan | 2024-08-14T06:20:55+00:00 |
Last Successful Scan
Scanned | 2024-04-17T06:19:47+00:00 |
URL | https://www.bignews1.com/robots.txt |
Domain IPs | 104.21.12.150, 172.67.132.41, 2606:4700:3031::ac43:8429, 2606:4700:3032::6815:c96 |
Response IP | 172.67.132.41 |
Found | Yes |
Hash | 6d7aac122cfbf93f74d6459ea2a9c6b71f78f74e6b1a1f8fc49d8ee6ba4b6543 |
SimHash | 69049b704753 |
Other Records
Field | Value |
---|---|
sitemap | https://www.bignews1.com/atom.xml?redirect=false&start-index=1&max-results=500 |