90phutu.cc
robots.txt

Robots Exclusion Standard data for 90phutu.cc

Resource Scan

Scan Details

Site Domain 90phutu.cc
Base Domain 90phutu.cc
Scan Status Ok
Last Scan5/17/2025, 10:53:57 PM
Next Scan 6/16/2025, 10:53:57 PM

Last Scan

Scanned5/17/2025, 10:53:57 PM
URL https://90phutu.cc/robots.txt
Redirect https://90phutsq.cc/robots.txt
Redirect Domain 90phutsq.cc
Redirect Base 90phutsq.cc
Domain IPs 104.21.49.196, 172.67.166.200, 2606:4700:3034::6815:31c4, 2606:4700:3037::ac43:a6c8
Redirect IPs 104.21.65.93, 172.67.189.184, 2606:4700:3032::6815:415d, 2606:4700:3033::ac43:bdb8
Response IP 104.21.65.93
Found Yes
Hash 8574d6c698fe153a82a7b75e91d6a17c3f35a429c01be5ae652030213c57a19f
SimHash 6969dc048102

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /but-danh/
Disallow /*/trackback
Disallow /img/
Disallow /tag/
Disallow /feed
Disallow /*/feed
Disallow /comments/feed
Disallow /?s=*
Disallow /attachment/
Disallow *?link=
Disallow *?ngay=
Disallow /*?utm_source
Disallow /*%26utm_source

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
sitemap https://90phutsq.cc/sitemap.xml

Comments

  • Allow Facebook scraper