gitconnected.com
robots.txt

Robots Exclusion Standard data for gitconnected.com

Resource Scan

Scan Details

Site Domain gitconnected.com
Base Domain gitconnected.com
Scan Status Ok
Last Scan2025-06-14T02:53:50+00:00
Next Scan 2025-07-14T02:53:50+00:00

Last Scan

Scanned2025-06-14T02:53:50+00:00
URL https://gitconnected.com/robots.txt
Domain IPs 13.52.155.236, 54.215.168.119
Response IP 13.52.155.236
Found Yes
Hash c52e66d1c1054925b7ff4581af797d91e919efd4130a3aa48dff0737bdf78ed8
SimHash 6c085c67cb15

Groups

*

Rule Path
Disallow /auth/*
Disallow /*/settings/*
Disallow /*/followers
Disallow /*/following
Disallow /v1/*
Disallow /jobs/*

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://gitconnected.com/sitemap_index.xml