authorsden.com
robots.txt
Robots Exclusion Standard data for authorsden.com
Resource Scan
Scan Details
| Site Domain | authorsden.com |
| Base Domain | authorsden.com |
| Scan Status | Ok |
| Last Scan | 2024-06-29T02:07:40+00:00 |
| Next Scan | 2024-07-06T02:07:40+00:00 |
Last Scan
| Scanned | 2024-06-29T02:07:40+00:00 |
| URL | https://authorsden.com/robots.txt |
| Domain IPs | 64.87.22.186 |
| Response IP | 64.87.22.186 |
| Found | Yes |
| Hash | 9584a796bf802b46cb4deae0d375482f1a674c6d110155d21d4a0b72a6680131 |
| SimHash | 66486b84d280 |
Groups
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /readers/ |
| Disallow | /sharepage.asp |
| Disallow | /plans/ |
| Disallow | /den/ |
| Disallow | /go/ |
| Disallow | /publishamerica/ |
| Disallow | /cgi-bin/ |
| Disallow | /essentials/ |
| Disallow | /internal/ |
| Disallow | /craig/ |
| Disallow | /includes/linkreport2.asp |
| Disallow |
googlebot
| Rule | Path |
|---|---|
| Disallow | /readers/ |
| Disallow | /sharepage.asp |
| Disallow | /plans/ |
| Disallow | /den/ |
| Disallow | /go/ |
| Disallow | /publishamerica/ |
| Disallow | /cgi-bin/ |
| Disallow | /essentials/ |
| Disallow | /internal/ |
| Disallow | /craig/ |
| Disallow | /includes/linkreport2.asp |
| Disallow |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /readers/ |
| Disallow | /sharepage.asp |
| Disallow | /plans/ |
| Disallow | /go/ |
| Disallow | /den/ |
| Disallow | /publishamerica/ |
| Disallow | /cgi-bin/ |
| Disallow | /essentials/ |
| Disallow | /internal/ |
| Disallow | /craig/ |
| Disallow | /includes/linkreport2.asp |
| Disallow |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /readers/ |
| Disallow | /sharepage.asp |
| Disallow | /plans/ |
| Disallow | /den/ |
| Disallow | /go/ |
| Disallow | /publishamerica/ |
| Disallow | /cgi-bin/ |
| Disallow | /essentials/ |
| Disallow | /internal/ |
| Disallow | /craig/ |
| Disallow | /includes/linkreport2.asp |
| Disallow |
bingbot
| Rule | Path |
|---|---|
| Disallow | /members/ |
| Disallow | /readers/ |
| Disallow | /sharepage.asp |
| Disallow | /plans/ |
| Disallow | /go/ |
| Disallow | /den/ |
| Disallow | /help/ |
| Disallow | /publishamerica/ |
| Disallow | /cgi-bin/ |
| Disallow | /essentials/ |
| Disallow | /internal/ |
| Disallow | /craig/ |
| Disallow | /includes/linkreport2.asp |
| Disallow |
msnbot
| Rule | Path |
|---|---|
| Disallow | /members/ |
| Disallow | /readers/ |
| Disallow | /sharepage.asp |
| Disallow | /plans/ |
| Disallow | /go/ |
| Disallow | /den/ |
| Disallow | /help/ |
| Disallow | /publishamerica/ |
| Disallow | /cgi-bin/ |
| Disallow | /essentials/ |
| Disallow | /internal/ |
| Disallow | /craig/ |
| Disallow | /includes/linkreport2.asp |
| Disallow |
vegi bot (we follow your robots.txt settings before crawling, you can slow down the bot by change the crawl-delay parameter in the settings.if you have an enquiry, please email to: abuse-report@terrykyleseoagency.com)
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 2 invalid lines.