rickscloud.com
robots.txt

Robots Exclusion Standard data for rickscloud.com

Resource Scan

Scan Details

Site Domain rickscloud.com
Base Domain rickscloud.com
Scan Status Ok
Last Scan2025-08-13T03:36:59+00:00
Next Scan 2025-09-12T03:36:59+00:00

Last Scan

Scanned2025-08-13T03:36:59+00:00
URL https://rickscloud.com/robots.txt
Redirect https://rickscloud.ai/robots.txt
Redirect Domain rickscloud.ai
Redirect Base rickscloud.ai
Domain IPs 104.21.19.199, 172.67.188.153, 2606:4700:3033::6815:13c7, 2606:4700:3034::ac43:bc99
Redirect IPs 18.206.97.39
Response IP 18.206.97.39
Found Yes
Hash d92054456557b65afb431d3eddf07d2be163715393517fbd269f9892c769a7af
SimHash 490148442693

Groups

scrapy

Rule Path
Allow /wp-content/uploads/

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /tag/

Other Records

Field Value
sitemap https://www.rickscloud.ai/sitemap.xml.gz