seo.xenite.org
robots.txt

Robots Exclusion Standard data for seo.xenite.org

Resource Scan

Scan Details

Site Domain seo.xenite.org
Base Domain xenite.org
Scan Status Ok
Last Scan2024-10-06T21:10:39+00:00
Next Scan 2024-10-13T21:10:39+00:00

Last Scan

Scanned2024-10-06T21:10:39+00:00
URL https://seo.xenite.org/robots.txt
Domain IPs 192.96.218.79
Response IP 192.96.218.79
Found Yes
Hash 233c50c2c0b51a2666da14629431481b968416c427d9ecde172187e8aba96df2
SimHash 4b2cfbd25455

Groups

baiduspider
bingbot
duckduckbot
exabot
facebookexternalhit
feedfetcher-google
google-inspectiontool
google-site-verification
google-speakr
googlebot
googlebot-image
googlebot-news
googlebot-video
mediapartners-google
msnbot
qwantify
speedyspider
twitterbot
yandexantivirus/2.0
yandexbot/3.0
yandeximageresizer/2.0
yandeximages/3.0
yandexmedia/3.0
yandexpagechecker/1.0
yandexwebmaster/2.0
yandexzakladki/3.0

Rule Path
Disallow /?s*
Disallow /?relatedposts*
Disallow *pw_post_layout/*
Disallow /cgi-bin/
Disallow /go/
Disallow /link/
Disallow /show/
Disallow /visit/

baiduspider
bingbot
duckduckbot
exabot
facebookexternalhit
feedfetcher-google
google-inspectiontool
google-site-verification
google-speakr
googlebot
googlebot-image
googlebot-news
googlebot-video
mediapartners-google
msnbot
qwantify
speedyspider
twitterbot
yandexantivirus/2.0
yandexbot/3.0
yandeximageresizer/2.0
yandeximages/3.0
yandexmedia/3.0
yandexpagechecker/1.0
yandexwebmaster/2.0
yandexzakladki/3.0

Rule Path
Disallow /?s*
Disallow /cgi-bin/
Disallow /go/
Disallow /link/
Disallow /show/
Disallow /visit/
Disallow /wp-admin/

ahrefsbot
ccbot/2.0
chatgpt-user
google-cloudvertexbot
google-extended
googleother
mj12bot
mojeekbot
petalbot
semrushbot
similarweb
yepbot
youbot
*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://seo.xenite.org/seo-sitemap.txt
sitemap https://middle-earth.xenite.org/middle-earth-sitemap.txt
sitemap https://middle-earth.xenite.org/middle-earth-hotzone-sitemap.txt
sitemap https://middle-earth.xenite.org/sitemap-1.xml
sitemap https://middle-earth.xenite.org/news-sitemap.xml

Comments

  • This Alternate robots.txt file was created by the Alternate Robots.txt WordPress plugin.
  • robots.txt file for https://seo.xenite.org/
  • Allow the good bots in
  • robots.txt for https://middle-earth.xenite.org/
  • Allow the good bots in
  • Block the well-behaved unwanted bots