marcospecialties.com
robots.txt

Robots Exclusion Standard data for marcospecialties.com

Resource Scan

Scan Details

Site Domain marcospecialties.com
Base Domain marcospecialties.com
Scan Status Ok
Last Scan2024-05-18T02:42:58+00:00
Next Scan 2024-06-17T02:42:58+00:00

Last Scan

Scanned2024-05-18T02:42:58+00:00
URL https://marcospecialties.com/robots.txt
Redirect https://www.marcospecialties.com/robots.txt
Redirect Domain www.marcospecialties.com
Redirect Base marcospecialties.com
Domain IPs 172.66.40.80, 172.66.43.176, 2606:4700:3108::ac42:2850, 2606:4700:3108::ac42:2bb0
Redirect IPs 172.66.40.80, 172.66.43.176, 2606:4700:3108::ac42:2850, 2606:4700:3108::ac42:2bb0
Response IP 172.66.40.80
Found Yes
Hash 551f4664a9ed160529102df50435bd126e8022a829e24f8723fc0af316c5ba3f
SimHash 8a54f32cc74b

Groups

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

sogou develop spider

Rule Path
Disallow /

sogou head spider

Rule Path
Disallow /

sogou js robot

Rule Path
Disallow /

sogou orion spider

Rule Path
Disallow /

sogou pic agent

Rule Path
Disallow /

sogou pic spider

Rule Path
Disallow /

sogou push spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou-test-spider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

Comments

  • Baiduspider
  • Sogou Bot Blocking
  • YandexBot