news.cygnus-x1.net
robots.txt

Robots Exclusion Standard data for news.cygnus-x1.net

Resource Scan

Scan Details

Site Domain news.cygnus-x1.net
Base Domain cygnus-x1.net
Scan Status Ok
Last Scan2025-05-06T14:02:14+00:00
Next Scan 2025-06-05T14:02:14+00:00

Last Scan

Scanned2025-05-06T14:02:14+00:00
URL https://news.cygnus-x1.net/robots.txt
Domain IPs 104.21.20.67, 172.67.191.217, 2606:4700:3030::6815:1443, 2606:4700:3033::ac43:bfd9
Response IP 104.21.20.67
Found Yes
Hash 00e5bf067d762bfa13c8d2face852d8b2ad5724a9498592c851372b45e2db0c4
SimHash 0d44d450c713

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Disallow /share-widget
Allow /

Other Records

Field Value
sitemap http://news.cygnus-x1.net/sitemap.xml