4yourwebsite.net
robots.txt
Robots Exclusion Standard data for 4yourwebsite.net
Resource Scan
Scan Details
Site Domain | 4yourwebsite.net |
Base Domain | 4yourwebsite.net |
Scan Status | Ok |
Last Scan | 2025-10-06T23:16:46+00:00 |
Next Scan | 2025-11-05T23:16:46+00:00 |
Last Scan
Scanned | 2025-10-06T23:16:46+00:00 |
URL | https://4yourwebsite.net/robots.txt |
Domain IPs | 104.21.79.148, 172.67.146.79, 2606:4700:3030::6815:4f94, 2606:4700:3033::ac43:924f |
Response IP | 104.21.79.148 |
Found | Yes |
Hash | 376b006521b481a6ebd28338de418668601258c94355d203b0687d1c80bb90fe |
SimHash | 79016b402f90 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /images/ |
Disallow | /include/ |
Disallow | /includes/ |
Disallow | /moving.page/ |
Disallow | /suspended.page/ |
Disallow | /pages/ |
Disallow | /400.shtml |
Disallow | /401.shtml |
Disallow | /403.shtml |
Disallow | /404.shtml |
Disallow | /500.shtml |
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
sitemap | https://4yourwebsite.com/sitemap.xml |