semyana.com
robots.txt

Robots Exclusion Standard data for semyana.com

Resource Scan

Scan Details

Site Domain semyana.com
Base Domain semyana.com
Scan Status Ok
Last Scan2026-02-03T05:08:10+00:00
Next Scan 2026-03-05T05:08:10+00:00

Last Scan

Scanned2026-02-03T05:08:10+00:00
URL https://semyana.com/robots.txt
Domain IPs 104.21.16.80, 172.67.166.242, 2606:4700:3030::6815:1050, 2606:4700:3037::ac43:a6f2
Response IP 172.67.166.242
Found Yes
Hash df935c8c2432e2bb727d6d0fa43ebdfcc530f090e336589eb375bc9f8dc7f06e
SimHash 01041d4defd0

Groups

*

Rule Path
Disallow /get_video_by_hash/
Disallow /get_top_feed/
Disallow /user/
Disallow /login/
Disallow /report/
Disallow /*/?pubpl=
Disallow /embed/
Disallow /get_related_videos/

googlebot

Rule Path
Disallow /get_video_by_hash/
Disallow /get_top_feed/
Disallow /user/
Disallow /login/
Disallow /report/
Disallow /*/?pubpl=
Disallow /embed/
Disallow /get_related_videos/

Other Records

Field Value
sitemap https://semyana.club/sitemaps/index.xml
sitemap https://semyana.club/sitemaps/google-index.xml

Warnings

  • `host` is not a known field.