animet3.info
robots.txt

Robots Exclusion Standard data for animet3.info

Resource Scan

Scan Details

Site Domain animet3.info
Base Domain animet3.info
Scan Status Ok
Last Scan2/14/2025, 11:42:44 PM
Next Scan 3/16/2025, 11:42:44 PM

Last Scan

Scanned2/14/2025, 11:42:44 PM
URL https://animet3.info/robots.txt
Redirect https://anime1.site/robots.txt
Redirect Domain anime1.site
Redirect Base anime1.site
Domain IPs 104.21.86.213, 172.67.136.226, 2606:4700:3032::ac43:88e2, 2606:4700:3035::6815:56d5
Redirect IPs 104.21.28.186, 172.67.147.76, 2606:4700:3031::ac43:934c, 2606:4700:3036::6815:1cba
Response IP 172.67.147.76
Found Yes
Hash bdd0f9dd12771db577e3cc9c4b2c0d5a2a099eb76532bceb8d69fc55485f0585
SimHash 623c82c1e3fb

Groups

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

ia_archiver

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

muso

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

musobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

coccoc

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

coccocbot-web

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /thanh-vien/
Disallow /tai-khoan/
Disallow /tu-phim/
Disallow /lich-su.html
Disallow /list-tap-luu.html
Disallow /tat-ca-thong-bao.html
Disallow /tim-kiem/
Disallow /ajax/
Disallow /facebook.html/
Disallow */?sort=
Disallow /cdn-cgi/challenge-platform/

Warnings

  • 3 invalid lines.