webeminence.com
robots.txt
Robots Exclusion Standard data for webeminence.com
Resource Scan
Scan Details
Site Domain | webeminence.com |
Base Domain | webeminence.com |
Scan Status | Ok |
Last Scan | 2025-10-20T12:06:37+00:00 |
Next Scan | 2025-10-27T12:06:37+00:00 |
Last Scan
Scanned | 2025-10-20T12:06:37+00:00 |
URL | https://webeminence.com/robots.txt |
Domain IPs | 104.21.23.159, 172.67.212.79, 2606:4700:3033::6815:179f, 2606:4700:3036::ac43:d44f |
Response IP | 104.21.23.159 |
Found | Yes |
Hash | ab9dd06866c50a69f9094e3921545d95bf8b7cfee44914e7824432de2e6ca3b6 |
SimHash | 65144b4ac6b1 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Disallow | /comments/feed/ |
Disallow | /feed/ |
Disallow | /trackback/ |
Disallow | /xmlrpc.php |
Disallow | /search? |
Disallow | /?p=* |
Other Records
Field | Value |
---|---|
sitemap | http://webeminence.com/sitemap.xml |