amdhub.in
robots.txt

Robots Exclusion Standard data for amdhub.in

Resource Scan

Scan Details

Site Domain amdhub.in
Base Domain amdhub.in
Scan Status Ok
Last Scan2025-10-29T08:35:23+00:00
Next Scan 2025-11-28T08:35:23+00:00

Last Scan

Scanned2025-10-29T08:35:23+00:00
URL https://amdhub.in/robots.txt
Domain IPs 13.126.164.169, 3.111.19.198, 52.66.51.82
Response IP 13.126.164.169
Found Yes
Hash 0ad25b873e782c86241b9cf82a1051684f84909bf2f9b91a2b90185ba2c4a202
SimHash 41801b40ceb6

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login/
Disallow /archive/
Allow /wp-admin/admin-ajax.php

chatgpt-user

Rule Path
Allow /

chatgpt

Rule Path
Allow /

gptbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

gemini

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

deepseekbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

ccbot

Rule Path
Allow /

youbot

Rule Path
Allow /

facebookbot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.amdhub.in/sitemap.xml

Comments

  • robots.txt for AMDHUB
  • General Crawlers
  • Explicitly allow AI crawlers
  • Sitemap location