wenewstw.com
robots.txt

Robots Exclusion Standard data for wenewstw.com

Resource Scan

Scan Details

Site Domain wenewstw.com
Base Domain wenewstw.com
Scan Status Ok
Last Scan2025-12-13T09:53:22+00:00
Next Scan 2025-12-20T09:53:22+00:00

Last Scan

Scanned2025-12-13T09:53:22+00:00
URL https://wenewstw.com/robots.txt
Domain IPs 104.21.25.54, 172.67.222.247, 2606:4700:3033::6815:1936, 2606:4700:3036::ac43:def7
Response IP 172.67.222.247
Found Yes
Hash 36948dbd94e7a6910d3a9507872de054cfd8ab8b14732cc63c053ae0f2d12bb8
SimHash 900dc3007f31

Groups

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

*

Rule Path
Allow /