jordantbh.me
robots.txt

Robots Exclusion Standard data for jordantbh.me

Resource Scan

Scan Details

Site Domain jordantbh.me
Base Domain jordantbh.me
Scan Status Ok
Last Scan2024-06-06T12:48:08+00:00
Next Scan 2024-06-13T12:48:08+00:00

Last Scan

Scanned2024-06-06T12:48:08+00:00
URL https://jordantbh.me/robots.txt
Domain IPs 104.21.35.7, 172.67.167.39, 2606:4700:3031::6815:2307, 2606:4700:3031::ac43:a727
Response IP 104.21.35.7
Found Yes
Hash 082acc107f69e11ad028c21c678c1d6da33b9193ba9647c1883152e443839bf4
SimHash 38102b9bcdc9

Groups

*

Rule Path
Allow /
Disallow /css
Disallow /images
Disallow /inc
Disallow /js
Disallow /letsgo
Disallow /notfound
Disallow /page
Disallow /privatedata
Disallow /recommend

Other Records

Field Value
sitemap http://jordantbh.me/sitemap.xml

Comments

  • The use of robots or other automated means to access the site
  • without the express permission from us is strictly prohibited.
  • Notwithstanding the foregoing, We may permit automated access to
  • access certain site pages but soley for the limited purpose of
  • including content in publicly available search engines. Any other
  • use of robots or failure to obey the robots exclusion standards set
  • forth at <http://www.robotstxt.org/ wc/ exclusion.html> is strictly
  • prohibited.