mywebsite2.com
robots.txt

Robots Exclusion Standard data for mywebsite2.com

Resource Scan

Scan Details

Site Domain mywebsite2.com
Base Domain mywebsite2.com
Scan Status Ok
Last Scan2025-11-27T23:00:58+00:00
Next Scan 2025-12-27T23:00:58+00:00

Last Scan

Scanned2025-11-27T23:00:58+00:00
URL https://mywebsite2.com/robots.txt
Domain IPs 208.122.223.71
Response IP 208.122.223.71
Found Yes
Hash f9db058c82c4ac213f6b194fdce32531a9eb12913e55a9ca12f23988ae9acbd2
SimHash b1198c86a211

Groups

*

Rule Path
Disallow /admin/
Disallow /includes/
Disallow /controllers/
Disallow /core/
Disallow /content/
Disallow /csv_photos/
Disallow /ftp_content/
Disallow /ftp_photos/
Disallow /temp_users_uploads/
Disallow /cache/

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /