ibeautytw.com
robots.txt
Robots Exclusion Standard data for ibeautytw.com
Resource Scan
Scan Details
| Site Domain | ibeautytw.com |
| Base Domain | ibeautytw.com |
| Scan Status | Ok |
| Last Scan | 2025-04-05T06:15:56+00:00 |
| Next Scan | 2025-04-12T06:15:56+00:00 |
Last Scan
| Scanned | 2025-04-05T06:15:56+00:00 |
| URL | https://ibeautytw.com/robots.txt |
| Redirect | https://koreanyori.com/robots.txt |
| Redirect Domain | koreanyori.com |
| Redirect Base | koreanyori.com |
| Domain IPs | 104.21.72.168, 172.67.187.33, 2606:4700:3033::6815:48a8, 2606:4700:3034::ac43:bb21 |
| Redirect IPs | 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001 |
| Response IP | 104.21.32.1 |
| Found | Yes |
| Hash | 858f4cb67d9d72d26b4f5ecde365df56ab953ab638a17274e61f3c5945ecc4e8 |
| SimHash | be4f7c86fc91 |
Groups
teleport
teleportpro
emailcollector
emailsiphon
webbandit
webzip
webreaper
webstripper
web downloader
ahrefsbot
semrushbot
mj12bot
webcopier
offline explorer pro
offline explorer
httrack website copier
offline commander
leech
websnake
blackwidow
http weazel
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /video/* |
| Disallow | /admin/ |
| Disallow | /dieu-khoan.html |
| Disallow | /lien-he.html |
| Disallow | /api/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://koreanyori.com/abcccc-sitemap.xml |