nordicxstream.com
robots.txt
Robots Exclusion Standard data for nordicxstream.com
Resource Scan
Scan Details
| Site Domain | nordicxstream.com |
| Base Domain | nordicxstream.com |
| Scan Status | Ok |
| Last Scan | 2024-09-25T03:30:11+00:00 |
| Next Scan | 2024-10-25T03:30:11+00:00 |
Last Scan
| Scanned | 2024-09-25T03:30:11+00:00 |
| URL | https://nordicxstream.com/robots.txt |
| Redirect | https://www.nordicxstream.com/robots.txt |
| Redirect Domain | www.nordicxstream.com |
| Redirect Base | nordicxstream.com |
| Domain IPs | 92.204.210.149 |
| Redirect IPs | 92.204.210.149 |
| Response IP | 92.204.210.149 |
| Found | Yes |
| Hash | 1dbc4cbff2dd9082571c0698246e12437af6973dcda719a75dc93c2e4ebce177 |
| SimHash | 7f10da82e0f4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
adidxbot
baiduspider
baiduspider-image
baiduspider-news
baiduspider-video
bingpreview
bublupbot
ccbot
cliqzbot
coccoc
coccocbot-image
coccocbot-web
daumoa
dazoobot
deusu
duckduckbot
duckduckgo-favicons-bot
euripbot
exploratodo
facebot
feedly
findxbot
haosouspider
ichiro
istellabot
jikespider
lycos
mail.ru
mediapartners-google
mojeekbot
orangebot
petalbot
pinterest
plukkie
qwantify
rambler
seznambot
seekportbot
sosospider
slurp
sogou blog
sogou inst spider
sogou news spider
sogou orion spider
sogou spider2
sogou web spider
sputnikbot
teoma
wotbox
yacybot
yandex
yandexmobilebot
yeti
yioopbot
yoozbot
youdaobot
googlebot-video
msnbot-media
my-tiny-bot
| Rule | Path |
|---|---|
| Disallow | / |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.nordicxstream.com/sitemap.xml |
| sitemap | https://www.nordicxstream.com/sitemap-news.xml |
Warnings
- 3 invalid lines.
Comments