Log In Sign Up

mactale.com
robots.txt

Robots Exclusion Standard data for mactale.com

Resource Scan

Scan Details

Site Domain mactale.com
Base Domain mactale.com
Scan Status Ok
Last Scan2025-06-19T23:35:59+00:00
Next Scan 2025-06-26T23:35:59+00:00

Last Scan

Scanned2025-06-19T23:35:59+00:00
URL https://www.mactale.com/robots.txt
Domain IPs 104.21.87.242, 172.67.148.201, 2606:4700:3031::6815:57f2, 2606:4700:3035::ac43:94c9
Response IP 104.21.87.242
Found Yes
Hash a7763b37e2cf567ecec5df4c46bc334c4b5718ef7336d5ae39e5efd367132e56
SimHash 4404115349d1

Groups

*

Rule Path
Disallow /css/
Disallow /scss/
Disallow /js/
Disallow /nav/

baiduspider

Rule Path
Disallow /*

haosouspider

Rule Path
Disallow /*

sogou web spider

Rule Path
Disallow /*

sogou inst spider

Rule Path
Disallow /*

sogou spider2

Rule Path
Disallow /*

twitterbot

Rule Path
Disallow *
Allow /images
Allow /article
Back to top

Other Records

Field Value
sitemap https://www.mactale.com/sitemap.xml
Back to top

Comments

  • robots.txt, Mon 10/06 2019
  • robots.txt for http://www.mactale.com/
  • author: keith orbit
  • ------------------------------------------------------
Back to top