crowstv.com
robots.txt

Robots Exclusion Standard data for crowstv.com

Resource Scan

Scan Details

Site Domain crowstv.com
Base Domain crowstv.com
Scan Status Ok
Last Scan2024-09-21T04:32:53+00:00
Next Scan 2024-09-28T04:32:53+00:00

Last Scan

Scanned2024-09-21T04:32:53+00:00
URL https://crowstv.com/robots.txt
Domain IPs 104.21.47.244, 172.67.174.143, 2606:4700:3032::6815:2ff4, 2606:4700:3033::ac43:ae8f
Response IP 172.67.174.143
Found Yes
Hash 5a7ed543fa97003cf2161c22df1b0cf696b1c50dcc6425e5d05615ec9a643f7d
SimHash 4001ca044f90

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://crowstv.com/attachment-sitemap.xml
sitemap https://crowstv.com/author-sitemap.xml
sitemap https://crowstv.com/post-sitemap.xml
sitemap https://crowstv.com/category-sitemap.xml
sitemap https://crowstv.com/post_tag-sitemap.xml