taggedpdf.com
robots.txt
Robots Exclusion Standard data for taggedpdf.com
Resource Scan
Scan Details
| Site Domain | taggedpdf.com |
| Base Domain | taggedpdf.com |
| Scan Status | Ok |
| Last Scan | 2024-10-05T05:21:52+00:00 |
| Next Scan | 2024-10-12T05:21:52+00:00 |
Last Scan
| Scanned | 2024-10-05T05:21:52+00:00 |
| URL | https://taggedpdf.com/robots.txt |
| Domain IPs | 104.21.87.64, 172.67.142.1, 2606:4700:3030::ac43:8e01, 2606:4700:3033::6815:5740 |
| Response IP | 104.21.87.64 |
| Found | Yes |
| Hash | 8371637fdfbb36a34de7012f5e87ae9347a18a79c8c8eae313eb1cd9e1988393 |
| SimHash | e24412526edf |
Groups
admantx
ahrefsbot
alexa
amazonadbot
bbot
blexbot
brands-bot
bytespider
ccbot
clickagy
cliqzbot
contxbot
datagnionbot
dotbot
dotmic
gluten free crawler
grapeshot
grapeshotcrawler
ias crawler
komodiabot
mail.ru_bot
megaindex.ru
mojeekbot
mj12bot
nimbostratus
nutch
obot
outclicksbot
phantomjs
proximic
qwantify
screaming frog seo spider
semanticscholarbot
semrushbot
seokicks
startmebot
tineye-bot
xovibot
zoominfobot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /trackback/ |
| Disallow | /xmlrpc.php |
| Disallow | /search |
| Disallow | /?s= |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://taggedpdf.com/sitemap_index.xml |
Warnings
- 1 invalid line.