Log In Sign Up

gitmind.ai
robots.txt

Robots Exclusion Standard data for gitmind.ai

Resource Scan

Scan Details

Site Domain gitmind.ai
Base Domain gitmind.ai
Scan Status Ok
Last Scan2025-09-22T18:51:11+00:00
Next Scan 2025-10-22T18:51:11+00:00

Last Scan

Scanned2025-09-22T18:51:11+00:00
URL https://gitmind.ai/robots.txt
Domain IPs 47.252.52.7
Response IP 47.252.52.7
Found Yes
Hash b4c648db04e532ac68368a00548a2fceafd9366213ad5381b30afd238abd99f2
SimHash 4c04dd525e90

Groups

twitterbot
*

Rule Path
Disallow /sitemapGenerator/
Disallow /pad/
Disallow /buy-vip/
Disallow /wp-admin/
Disallow /wp-content/
Disallow /contact/
Disallow /author/
Disallow /wp-images/
Disallow /docs/
Disallow /*?*

googlebot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

ia_archiver-web.archive.org

Rule Path
Allow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://lightpdf.com/sitemap.xml
Back to top