marketingwords.com
robots.txt

Robots Exclusion Standard data for marketingwords.com

Resource Scan

Scan Details

Site Domain marketingwords.com
Base Domain marketingwords.com
Scan Status Ok
Last Scan2024-09-11T22:05:47+00:00
Next Scan 2024-10-11T22:05:47+00:00

Last Scan

Scanned2024-09-11T22:05:47+00:00
URL https://marketingwords.com/robots.txt
Domain IPs 104.26.10.182, 104.26.11.182, 172.67.73.168, 2606:4700:20::681a:ab6, 2606:4700:20::681a:bb6, 2606:4700:20::ac43:49a8
Response IP 104.26.11.182
Found Yes
Hash 2a9201bf7689f7c6d0d28378031239e9d03c99161dae9b971e5bf1cc94297f6a
SimHash cb095c8aca32

Groups

duggmirror

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 3

googlebot

Rule Path
Disallow /*.cgi$
Disallow /*.inc$
Disallow /*.php$
Disallow /*.php*
Disallow /*.wmv$
Disallow /*.xhtml$
Disallow /trackback*
Disallow /z/

Other Records

Field Value
crawl-delay 3

*

Rule Path
Disallow /blog/date/
Disallow /favicon.ico
Disallow /httpd/
Disallow /blog/i/
Disallow /blog/j/
Disallow /stats/
Disallow /blog/t/
Disallow /blog/trackback
Disallow /blog/user/
Disallow /blog/user/register
Disallow /blog/wp-admin/
Disallow /blog/wp-content/plugins/
Disallow /blog/wp-includes/
Disallow /blog/wp-login.php
Disallow /blog/wp-login.php?action=register
Disallow /Template/
Disallow /date/
Disallow /i/
Disallow /j/
Disallow /t/
Disallow /tag/
Disallow /trackback
Disallow /user/
Disallow /user/register
Disallow /wp-admin/
Disallow /wp-content/plugins/
Disallow /wp-includes/
Disallow /wp-login.php
Disallow /wp-login.php?action=register

Other Records

Field Value
crawl-delay 3