mangoanimate.com
robots.txt

Robots Exclusion Standard data for mangoanimate.com

Resource Scan

Scan Details

Site Domain mangoanimate.com
Base Domain mangoanimate.com
Scan Status Ok
Last Scan2024-10-31T22:17:34+00:00
Next Scan 2024-11-30T22:17:34+00:00

Last Scan

Scanned2024-10-31T22:17:34+00:00
URL https://mangoanimate.com/robots.txt
Domain IPs 104.21.4.235, 172.67.154.62, 2606:4700:3031::ac43:9a3e, 2606:4700:3034::6815:4eb
Response IP 104.21.4.235
Found Yes
Hash e69746bd86d360cb3e508ad3b315cedd3e39a497cc4b70b4260255a7cdd35abc
SimHash 2864d873ea12

Groups

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou news spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sogou spider2

Rule Path
Disallow /

sogou blog

Rule Path
Disallow /

sogou orion spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

jike spider

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

toutiaospider

Rule Path
Disallow /

yahoo! slurp china

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

yaanibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /center/*
Disallow /v-*
Disallow /explore-ai/*

Other Records

Field Value
sitemap https://mangoanimate.com/sitemap/pages.xml
sitemap https://mangoanimate.com/sitemap/pages-ai.xml
sitemap https://mangoanimate.com/sitemap/videos.xml
sitemap https://mangoanimate.com/sitemap/latest-videos.xml

Warnings

  • 6 invalid lines.