selpers.com
robots.txt
Robots Exclusion Standard data for selpers.com
Resource Scan
Scan Details
| Site Domain | selpers.com |
| Base Domain | selpers.com |
| Scan Status | Ok |
| Last Scan | 2024-09-09T01:51:31+00:00 |
| Next Scan | 2024-10-09T01:51:31+00:00 |
Last Scan
| Scanned | 2024-09-09T01:51:31+00:00 |
| URL | https://selpers.com/robots.txt |
| Domain IPs | 85.13.153.109 |
| Response IP | 85.13.153.109 |
| Found | Yes |
| Hash | 5667b9ad80ef106ffb74dd9d74bf798811223afce524efd4947fdfd9696e01aa |
| SimHash | 4302a8fac4e7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /author |
| Disallow | /trackback |
| Disallow | /*trackback |
| Disallow | /*trackback* |
| Disallow | /*/trackback |
feedfetcher-google
msnbot-media
adidxbot
grapeshot
hyscore
termlabs.io
ahrefsbot
panscient.com
vscooter
psbot
ia_archiver
archive.org_bot
ia_archiver-web.archive.org
mj12bot
twiceler
yandex
taptubot
twengabot
sitebot
baiduspider
ahrefsbot
ezooms
aihitbot
infopath
infopath.2
swebot
ec2linkfinder
turnitinbot
searchmetericsbot
wbsearchbot
exabot
sosospider
ip-web-crawler.com
netestate ne crawler
aboundexbot
meanpathbot
mail.ru
spbot
archive.org_bot
linkpadbot
easouspider
seznambot
wotbox
cliqzbot
genieo
screaming frog seo spider
seznambot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://selpers.com/sitemap.xml |
Comments