nhatvip.town
robots.txt

Robots Exclusion Standard data for nhatvip.town

Resource Scan

Scan Details

Site Domain nhatvip.town
Base Domain nhatvip.town
Scan Status Ok
Last Scan2025-09-30T03:01:27+00:00
Next Scan 2025-10-30T03:01:27+00:00

Last Scan

Scanned2025-09-30T03:01:27+00:00
URL https://nhatvip.town/robots.txt
Redirect https://cottage.ru.com/robots.txt
Redirect Domain cottage.ru.com
Redirect Base cottage.ru.com
Domain IPs 104.21.43.172, 172.67.182.139, 2606:4700:3035::6815:2bac, 2606:4700:3035::ac43:b68b
Redirect IPs 104.21.13.7, 172.67.132.116, 2606:4700:3031::6815:d07, 2606:4700:3032::ac43:8474
Response IP 172.67.132.116
Found Yes
Hash a0407160018d20f642711933cf6b5504b69c1c60cc3ef800eff3cf81d18fa9b3
SimHash 62a0fa54ae92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /search
Disallow /wp-content/plugins/
Disallow /feed
Disallow /*/feed
Disallow /*/*/feed
Disallow /wp-content/litespeed/js/
Disallow /wp-content/themes/flatsome/assets/js/

oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot

Rule Path
Allow /

gptbot
ccbot
google-extended

Rule Path
Disallow /

googlebot
bingbot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

Other Records

Field Value
sitemap https://cottage.ru.com/sitemap_index.xml

Comments

  • Allow AI search and agent use
  • Disallow AI training data collection
  • Allow traditional search indexing