bigwnews.com
robots.txt

Robots Exclusion Standard data for bigwnews.com

Resource Scan

Scan Details

Site Domain bigwnews.com
Base Domain bigwnews.com
Scan Status Ok
Last Scan2025-04-13T13:46:52+00:00
Next Scan 2025-04-20T13:46:52+00:00

Last Scan

Scanned2025-04-13T13:46:52+00:00
URL https://bigwnews.com/robots.txt
Domain IPs 104.21.80.208, 172.67.153.209, 2606:4700:3031::6815:50d0, 2606:4700:3032::ac43:99d1
Response IP 104.21.80.208
Found Yes
Hash 16759d8ffbc857a1daa526f6c741bf4f47a1cc9826c96c75974811863c9592f4
SimHash 454504474531

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://bigwnews.com/sitemap_index.xml

Warnings

  • `host` is not a known field.