shopearny.com
robots.txt

Robots Exclusion Standard data for shopearny.com

Resource Scan

Scan Details

Site Domain shopearny.com
Base Domain shopearny.com
Scan Status Ok
Last Scan2024-09-27T19:27:47+00:00
Next Scan 2024-10-04T19:27:47+00:00

Last Scan

Scanned2024-09-27T19:27:47+00:00
URL https://shopearny.com/robots.txt
Domain IPs 104.21.37.232, 172.67.214.175, 2606:4700:3035::6815:25e8, 2606:4700:3037::ac43:d6af
Response IP 172.67.214.175
Found Yes
Hash e50fc949899e137c48c6308a96826925839f3ae001d07b67b49d6e4052b5c2b9
SimHash 810eda60c5c3

Groups

baiduspider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

*

Rule Path
Disallow /bin/

Other Records

Field Value
sitemap https://www.shopearny.com/sitemap.xml

Comments

  • robots.txt generated at http://tool.chinaz.com/robots/
  • Sitemap: http://localhost:3022/sitemap.xml