category.news
robots.txt

Robots Exclusion Standard data for category.news

Resource Scan

Scan Details

Site Domain category.news
Base Domain category.news
Scan Status Ok
Last Scan2024-09-28T12:43:06+00:00
Next Scan 2024-10-05T12:43:06+00:00

Last Scan

Scanned2024-09-28T12:43:06+00:00
URL https://category.news/robots.txt
Redirect https://www.category.news/robots.txt
Redirect Domain www.category.news
Redirect Base category.news
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 142.251.175.121, 2404:6800:4003:c1a::79
Response IP 172.253.118.121
Found Yes
Hash 8c60926e7e735307ab4cac017227f5cf70ede3ba4cce8e0e7246a5a2b15cd1d3
SimHash 69159250c753

Groups

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.category.news/sitemap.xml