bignews1.com
robots.txt

Robots Exclusion Standard data for bignews1.com

Resource Scan

Scan Details

Site Domain bignews1.com
Base Domain bignews1.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-06-15T06:20:55+00:00
Next Scan 2024-08-14T06:20:55+00:00

Last Successful Scan

Scanned2024-04-17T06:19:47+00:00
URL https://www.bignews1.com/robots.txt
Domain IPs 104.21.12.150, 172.67.132.41, 2606:4700:3031::ac43:8429, 2606:4700:3032::6815:c96
Response IP 172.67.132.41
Found Yes
Hash 6d7aac122cfbf93f74d6459ea2a9c6b71f78f74e6b1a1f8fc49d8ee6ba4b6543
SimHash 69049b704753

Groups

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.bignews1.com/atom.xml?redirect=false&start-index=1&max-results=500