marketingwords.com
robots.txt
Robots Exclusion Standard data for marketingwords.com
Resource Scan
Scan Details
Site Domain | marketingwords.com |
Base Domain | marketingwords.com |
Scan Status | Ok |
Last Scan | 2024-09-11T22:05:47+00:00 |
Next Scan | 2024-10-11T22:05:47+00:00 |
Last Scan
Scanned | 2024-09-11T22:05:47+00:00 |
URL | https://marketingwords.com/robots.txt |
Domain IPs | 104.26.10.182, 104.26.11.182, 172.67.73.168, 2606:4700:20::681a:ab6, 2606:4700:20::681a:bb6, 2606:4700:20::ac43:49a8 |
Response IP | 104.26.11.182 |
Found | Yes |
Hash | 2a9201bf7689f7c6d0d28378031239e9d03c99161dae9b971e5bf1cc94297f6a |
SimHash | cb095c8aca32 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /*.cgi$ |
Disallow | /*.inc$ |
Disallow | /*.php$ |
Disallow | /*.php* |
Disallow | /*.wmv$ |
Disallow | /*.xhtml$ |
Disallow | /trackback* |
Disallow | /z/ |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
*
Rule | Path |
---|---|
Disallow | /blog/date/ |
Disallow | /favicon.ico |
Disallow | /httpd/ |
Disallow | /blog/i/ |
Disallow | /blog/j/ |
Disallow | /stats/ |
Disallow | /blog/t/ |
Disallow | /blog/trackback |
Disallow | /blog/user/ |
Disallow | /blog/user/register |
Disallow | /blog/wp-admin/ |
Disallow | /blog/wp-content/plugins/ |
Disallow | /blog/wp-includes/ |
Disallow | /blog/wp-login.php |
Disallow | /blog/wp-login.php?action=register |
Disallow | /Template/ |
Disallow | /date/ |
Disallow | /i/ |
Disallow | /j/ |
Disallow | /t/ |
Disallow | /tag/ |
Disallow | /trackback |
Disallow | /user/ |
Disallow | /user/register |
Disallow | /wp-admin/ |
Disallow | /wp-content/plugins/ |
Disallow | /wp-includes/ |
Disallow | /wp-login.php |
Disallow | /wp-login.php?action=register |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |