today-tech-news.com
robots.txt
Robots Exclusion Standard data for today-tech-news.com
Resource Scan
Scan Details
Site Domain | today-tech-news.com |
Base Domain | today-tech-news.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-09-12T11:22:17+00:00 |
Next Scan | 2025-09-19T11:22:17+00:00 |
Last Successful Scan
Scanned | 2025-09-04T11:21:46+00:00 |
URL | https://today-tech-news.com/robots.txt |
Redirect | https://www.today-tech-news.com/robots.txt |
Redirect Domain | www.today-tech-news.com |
Redirect Base | today-tech-news.com |
Domain IPs | 2a02:4780:84:a857:7fe:6682:d05d:e550, 2a02:4780:84:b745:d973:6559:690f:30fd, 84.32.84.135, 84.32.84.84 |
Redirect IPs | 2a02:4780:15:ca13:f32d:3b55:7588:f871, 2a02:4780:38:751c:88b3:6e37:9c94:36f9, 77.37.48.169, 77.37.75.222 |
Response IP | 77.37.48.17 |
Found | Yes |
Hash | e16c5e3ea463ad7645e3941f6ba0fa01e547420ec975f9fced2ccd6ef3c72071 |
SimHash | 49009840c9b2 |
Other Records
Field | Value |
---|---|
sitemap | https://www.today-tech-news.com/sitemap_index.xml |