gmapsextractor.com
robots.txt

Robots Exclusion Standard data for gmapsextractor.com

Resource Scan

Scan Details

Site Domain gmapsextractor.com
Base Domain gmapsextractor.com
Scan Status Ok
Last Scan2025-07-15T05:43:10+00:00
Next Scan 2025-08-14T05:43:10+00:00

Last Scan

Scanned2025-07-15T05:43:10+00:00
URL https://gmapsextractor.com/robots.txt
Domain IPs 104.21.16.231, 172.67.216.209, 2606:4700:3031::6815:10e7, 2606:4700:3031::ac43:d8d1
Response IP 104.21.16.231
Found Yes
Hash 572c51b10c867b1b95da4c9ac2c582665703fed387b3d5a145c4f8432e037787
SimHash 45118970c611

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

gptbot
claude-web
anthropic-ai
anthropic-ai
perplexitybot
googleother
duckassistbot

Rule Path
Allow /llms.txt
Allow /

Other Records

Field Value
sitemap https://gmapsextractor.com/sitemap.xml

Comments

  • 默认规则组
  • AI爬虫规则组