Log In Sign Up

nationalgeographic.ge
robots.txt

Robots Exclusion Standard data for nationalgeographic.ge

Resource Scan

Scan Details

Site Domain nationalgeographic.ge
Base Domain nationalgeographic.ge
Scan Status Ok
Last Scan2024-05-17T06:35:59+00:00
Next Scan 2024-05-24T06:35:59+00:00

Last Scan

Scanned2024-05-17T06:35:59+00:00
URL https://nationalgeographic.ge/robots.txt
Domain IPs 104.21.58.151, 172.67.205.44, 2606:4700:3034::6815:3a97, 2606:4700:3036::ac43:cd2c
Response IP 104.21.58.151
Found Yes
Hash 03da9607cf9e0b325932ee882c732e99fbed443c7376b54b81d1cece124765bf
SimHash 00525940a132

Groups

claritybot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow /wp/wp-admin/
Back to top

Comments

  • robots.txt for https://nationalgeographic.ge/
Back to top