jsoup.org
robots.txt

Robots Exclusion Standard data for jsoup.org

Resource Scan

Scan Details

Site Domain jsoup.org
Base Domain jsoup.org
Scan Status Ok
Last Scan2025-10-17T06:31:52+00:00
Next Scan 2025-11-16T06:31:52+00:00

Last Scan

Scanned2025-10-17T06:31:52+00:00
URL https://jsoup.org/robots.txt
Domain IPs 104.21.7.68, 172.67.187.139, 2606:4700:3032::ac43:bb8b, 2606:4700:3033::6815:744
Response IP 172.67.187.139
Found Yes
Hash 0d3c625d7b688bfefd5b6de2a80df6d5759deadcd79eb20b23b944bd5b3fa031
SimHash 69099d4c8d93

Groups

*

Rule Path
Disallow /plans/*
Disallow /passwords/*
Disallow /launch-codes/*

Other Records

Field Value
sitemap https://jsoup.org/sitemap.xml