androidcrunch.com
robots.txt

Robots Exclusion Standard data for androidcrunch.com

Resource Scan

Scan Details

Site Domain androidcrunch.com
Base Domain androidcrunch.com
Scan Status Ok
Last Scan2025-10-06T10:52:24+00:00
Next Scan 2025-10-13T10:52:24+00:00

Last Scan

Scanned2025-10-06T10:52:24+00:00
URL https://androidcrunch.com/robots.txt
Redirect https://www.androidcrunch.com/robots.txt
Redirect Domain www.androidcrunch.com
Redirect Base androidcrunch.com
Domain IPs 104.21.8.72, 172.67.156.234, 2606:4700:3037::6815:848, 2606:4700:3037::ac43:9cea
Redirect IPs 104.21.8.72, 172.67.156.234, 2606:4700:3037::6815:848, 2606:4700:3037::ac43:9cea
Response IP 172.67.156.234
Found Yes
Hash e0c270a3acd3dbc9504050f36be68bc32387b68ed415c0a5013362a9f2e9ebce
SimHash 490049408591

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/
Allow /wp-content/uploads/

Other Records

Field Value
sitemap https://www.androidcrunch.com/sitemap_index.xml