isunwin.dev
robots.txt

Robots Exclusion Standard data for isunwin.dev

Resource Scan

Scan Details

Site Domain isunwin.dev
Base Domain isunwin.dev
Scan Status Ok
Last Scan2025-08-08T12:14:04+00:00
Next Scan 2025-09-07T12:14:04+00:00

Last Scan

Scanned2025-08-08T12:14:04+00:00
URL https://isunwin.dev/robots.txt
Redirect https://www.sexshop.ru.com/robots.txt
Redirect Domain www.sexshop.ru.com
Redirect Base sexshop.ru.com
Domain IPs 104.21.48.112, 172.67.150.180, 2606:4700:3034::6815:3070, 2606:4700:3037::ac43:96b4
Redirect IPs 104.21.16.182, 172.67.215.64, 2606:4700:3034::ac43:d740, 2606:4700:3037::6815:10b6
Response IP 104.21.16.182
Found Yes
Hash 956feb1d68904718ad38f07ab313db4a192f3565d0e1aaa26968a04ba0064b63
SimHash 62a0bad0ee96

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /search
Disallow /wp-content/plugins/
Disallow /feed
Disallow /*/feed
Disallow /*/*/feed
Disallow /wp-content/litespeed/js/
Disallow /wp-content/themes/flatsome/assets/js/

oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot

Rule Path
Allow /

gptbot
ccbot
google-extended

Rule Path
Disallow /

googlebot
bingbot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

Other Records

Field Value
sitemap https://www.sexshop.ru.com/sitemap_index.xml

Comments

  • Allow AI search and agent use
  • Disallow AI training data collection
  • Allow traditional search indexing