wdxcyber.com
robots.txt
Robots Exclusion Standard data for wdxcyber.com
Resource Scan
Scan Details
Site Domain | wdxcyber.com |
Base Domain | wdxcyber.com |
Scan Status | Ok |
Last Scan | 2024-11-14T03:34:07+00:00 |
Next Scan | 2024-11-21T03:34:07+00:00 |
Last Scan
Scanned | 2024-11-14T03:34:07+00:00 |
URL | https://wdxcyber.com/robots.txt |
Domain IPs | 104.21.3.207, 172.67.131.47, 2606:4700:3032::6815:3cf, 2606:4700:3037::ac43:832f |
Response IP | 172.67.131.47 |
Found | Yes |
Hash | 7905efb084910b3629a123c99cbc838542cbf51dcb0d12583e0506b3a5dc570e |
SimHash | 7085d455cd10 |
Groups
*
Rule | Path |
---|---|
Disallow | /nts/ |
Disallow | /forums/register.html |
Disallow | /forums/passwordRequest.html |
Disallow | /forums/forum_faq.html |
Disallow | /forums/login.html |
Disallow | /forums/viewprofile.html |
Disallow | /forums/profile.html |
Other Records
Field | Value |
---|---|
sitemap | http://www.wdxcyber.com/sitemap.xml |