contentuniq.com
robots.txt

Robots Exclusion Standard data for contentuniq.com

Resource Scan

Scan Details

Site Domain contentuniq.com
Base Domain contentuniq.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-05T02:28:22+00:00
Next Scan 2024-12-04T02:28:22+00:00

Last Successful Scan

Scanned2024-01-17T01:06:48+00:00
URL https://contentuniq.com/robots.txt
Domain IPs 104.21.48.124, 172.67.186.90, 2606:4700:3030::6815:307c, 2606:4700:3033::ac43:ba5a
Response IP 104.21.48.124
Found Yes
Hash 535c8b35dfcf81f6abc44a2ac8d981edf152bd0d5a27cc800f8e96647bddebbe
SimHash 810159414712

Groups

*

Rule Path
Disallow /pdf/
Disallow *.pdf

Comments

  • robots.txt