thenewsspy.technology
robots.txt

Robots Exclusion Standard data for thenewsspy.technology

Resource Scan

Scan Details

Site Domain thenewsspy.technology
Base Domain thenewsspy.technology
Scan Status Ok
Last Scan2025-09-19T06:16:48+00:00
Next Scan 2025-10-19T06:16:48+00:00

Last Scan

Scanned2025-09-19T06:16:48+00:00
URL https://thenewsspy.technology/robots.txt
Domain IPs 104.21.71.145, 172.67.145.124, 2606:4700:3032::6815:4791, 2606:4700:3033::ac43:917c
Response IP 172.67.145.124
Found Yes
Hash e489bc49159565cb87ccfffc1b472570f29a00d46d69ac0a77f487beb0dc6608
SimHash 6d050c50ed11

Groups

*

Rule Path
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://thenewsspy.technology/sitemap.xml