mangoanimate.com
robots.txt

Robots Exclusion Standard data for mangoanimate.com

Resource Scan

Scan Details

Site Domain mangoanimate.com
Base Domain mangoanimate.com
Scan Status Ok
Last Scan2024-09-01T22:17:16+00:00
Next Scan 2024-10-01T22:17:16+00:00

Last Scan

Scanned2024-09-01T22:17:16+00:00
URL https://mangoanimate.com/robots.txt
Domain IPs 104.21.4.235, 172.67.154.62, 2606:4700:3031::ac43:9a3e, 2606:4700:3034::6815:4eb
Response IP 104.21.4.235
Found Yes
Hash 2f3b7dfd98ede27906d6da28ea78e70e7472cc23038dc25a7bad33def6db9e55
SimHash 2844d9736b12

Groups

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou news spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sogou spider2

Rule Path
Disallow /

sogou blog

Rule Path
Disallow /

sogou orion spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

jike spider

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

toutiaospider

Rule Path
Disallow /

yahoo! slurp china

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

yaanibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /center/*
Disallow /v-*

Other Records

Field Value
sitemap https://mangoanimate.com/sitemap/pages.xml
sitemap https://mangoanimate.com/sitemap/pages-ai.xml
sitemap https://mangoanimate.com/sitemap/videos.xml
sitemap https://mangoanimate.com/sitemap/latest-videos.xml

Warnings

  • 6 invalid lines.