baeldung.com
robots.txt

Robots Exclusion Standard data for baeldung.com

Resource Scan

Scan Details

Site Domain baeldung.com
Base Domain baeldung.com
Scan Status Ok
Last Scan2024-06-14T16:26:30+00:00
Next Scan 2024-06-21T16:26:30+00:00

Last Scan

Scanned2024-06-14T16:26:30+00:00
URL https://baeldung.com/robots.txt
Domain IPs 172.66.40.248, 172.66.43.8, 2606:4700:3108::ac42:28f8, 2606:4700:3108::ac42:2b08
Response IP 172.66.40.248
Found Yes
Hash 4d8fed20a2b91bf514cd6ed57c5ca81449c31b2ccffdf22c75ab8fa5ed94c668
SimHash 1a45fa608eb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /linux/wp-admin/
Allow /linux/wp-admin/admin-ajax.php
Disallow /scala/wp-admin/
Allow /scala/wp-admin/admin-ajax.php
Disallow /cs/wp-admin/
Allow /cs/wp-admin/admin-ajax.php
Disallow /kotlin/wp-admin/
Allow /kotlin/wp-admin/admin-ajax.php
Disallow /ops/wp-admin/
Allow /ops/wp-admin/admin-ajax.php
Disallow /sql/wp-admin/
Allow /sql/wp-admin/admin-ajax.php
Disallow /members/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.baeldung.com/sitemap.xml
sitemap https://www.baeldung.com/linux/sitemap.xml
sitemap https://www.baeldung.com/cs/sitemap.xml
sitemap https://www.baeldung.com/scala/sitemap.xml
sitemap https://www.baeldung.com/kotlin/sitemap.xml