tigerfan.com
robots.txt

Robots Exclusion Standard data for tigerfan.com

Resource Scan

Scan Details

Site Domain tigerfan.com
Base Domain tigerfan.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-12-22T01:12:10+00:00
Next Scan 2026-03-22T01:12:10+00:00

Last Successful Scan

Scanned2025-05-03T07:46:57+00:00
URL https://tigerfan.com/robots.txt
Domain IPs 104.21.22.12, 172.67.201.208, 2606:4700:3033::6815:160c, 2606:4700:3036::ac43:c9d0
Response IP 172.67.201.208
Found Yes
Hash 60a97a8278b1a6bada6514e93472be690e6fb8ff56bd2171c6b38a80076a30a0
SimHash 325042d28f83

Groups

ahrefsbot
baidu
baiduspider
baiduspider-video
baiduspider-image
cliqzbot
diffbot
dotbot
easouspider
exabot
linkdexbot
linkdexbot-mobile
magpie-crawler
meanpathbot
mj12bot
naverbot
omgilibot
proximic
rogerbot
sitebot
sogou
sogou spider
sogou web spider
spbot
trendictionbot
twiceler
urlappendbot
yandex
youdaobot
yeti

Rule Path
Disallow /

*

Rule Path
Disallow /?page=
Disallow /find-new/
Disallow /account/
Disallow /attachments/
Disallow /goto/
Disallow /posts/
Disallow /login/
Disallow /admin.php
Disallow /members/
Disallow /conversations/
Allow /

Other Records

Field Value
sitemap http://tigerfan.com/sitemap/sitemap.xml.gz