Log In Sign Up

anasaea.com
robots.txt

Robots Exclusion Standard data for anasaea.com

Resource Scan

Scan Details

Site Domain anasaea.com
Base Domain anasaea.com
Scan Status Ok
Last Scan2024-10-07T01:03:44+00:00
Next Scan 2024-10-21T01:03:44+00:00

Last Scan

Scanned2024-10-07T01:03:44+00:00
URL https://anasaea.com/robots.txt
Domain IPs 104.26.6.208, 104.26.7.208, 172.67.71.142, 2606:4700:20::681a:6d0, 2606:4700:20::681a:7d0, 2606:4700:20::ac43:478e
Response IP 172.67.71.142
Found Yes
Hash dc18da3fbdd8b259fac90779275d21525eba0b75c8d517dc44ffd2c10e30d642
SimHash 636d9041c891

Groups

*

Rule Path
Disallow /admin/

sogou spider

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

ezooms/1.0

Rule Path
Disallow /

mozilla/5.0 (compatible; ezooms/1.0; ezooms.bot[at]gmail[dot]com)

Rule Path
Disallow /

exabot

Rule Path
Disallow /

exaleadcloudview

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

xintellibot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

mozilla/5.0 (compatible; tweetedtimes bot/1.0; +http://tweetedtimes.com)

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

rollcrawl

Rule Path
Disallow /

cliqusbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.anasaea.com/sitemap.xml
Back to top