techgeel.com
robots.txt

Robots Exclusion Standard data for techgeel.com

Resource Scan

Scan Details

Site Domain techgeel.com
Base Domain techgeel.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-05-27T00:04:07+00:00
Next Scan 2024-07-26T00:04:07+00:00

Last Successful Scan

Scanned2024-03-28T23:32:36+00:00
URL https://techgeel.com/robots.txt
Redirect https://urb.im//robots.txt
Redirect Domain urb.im
Redirect Base urb.im
Domain IPs 65.109.30.121
Redirect IPs 65.109.30.121
Response IP 65.109.30.121
Found Yes
Hash 64e2b86e8f368bde5165f50348e9ab3a1b62244ee89ad2fc18b02767ec4f45d7
SimHash 5a1cc948e831

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /plugins/
Disallow /themes/
Disallow /uploads/
Allow /wp-content/uploads/

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mozbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

Other Records

Field Value
sitemap https://urb.im/sitemap_index.xml