geocaching.su
robots.txt

Robots Exclusion Standard data for geocaching.su

Resource Scan

Scan Details

Site Domain geocaching.su
Base Domain geocaching.su
Scan Status Ok
Last Scan2024-09-23T22:04:29+00:00
Next Scan 2024-09-30T22:04:29+00:00

Last Scan

Scanned2024-09-23T22:04:29+00:00
URL https://geocaching.su/robots.txt
Domain IPs 91.236.141.89
Response IP 91.236.141.89
Found Yes
Hash 53808e53f8de633916fa164299279ffaf59030fbb89dea727545e974b5280245
SimHash ba5b8dc37df1

Groups

yandex

Rule Path
Disallow /members/
Disallow /manage/
Disallow /ajax/
Disallow /js/
Disallow /css/
Disallow /api/
Disallow /oauth/
Disallow /railroad/

googlebot

Rule Path
Disallow /members/
Disallow /manage/
Disallow /ajax/
Disallow /js/
Disallow /css/
Disallow /api/
Disallow /oauth/
Disallow /railroad/
Disallow /*?*utm_source=
Disallow /*?*utm_medium=
Disallow /*?*utm_term=
Disallow /*?*utm_campaign=

*

Rule Path
Disallow /members/
Disallow /manage/
Disallow /ajax/
Disallow /js/
Disallow /css/
Disallow /api/
Disallow /oauth/
Disallow /railroad/
Disallow /*?*utm_

mauibot

Rule Path
Disallow /phorum/

semrushbot

Rule Path
Disallow /phorum/

ahrefsbot

Rule Path
Disallow /phorum/

blexbot

Rule Path
Disallow /phorum/

seo spider

Rule Path
Disallow /phorum/

*

Rule Path
Disallow /phorum/admin/
Disallow /phorum/auth/
Disallow /phorum/assets/browser-update*.js
Disallow /phorum/email/
Disallow /phorum/session
Disallow /phorum/user-api-key
Disallow /phorum/*?api_key*
Disallow /phorum/*?*api_key*
Disallow /phorum/badges
Disallow /phorum/u/
Disallow /phorum/my
Disallow /phorum/search
Disallow /phorum/tag/*/l
Disallow /phorum/g
Disallow /phorum/t/*/*.rss
Disallow /phorum/c/*.rss

googlebot

Rule Path
Disallow /phorum/admin/
Disallow /phorum/auth/
Disallow /phorum/assets/browser-update*.js
Disallow /phorum/email/
Disallow /phorum/session
Disallow /phorum/user-api-key
Disallow /phorum/*?api_key*
Disallow /phorum/*?*api_key*

Comments

  • PHORUM ROBOTS
  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • This robots.txt file is not used. Please append the content below in the robots.txt file located at the root

Warnings

  • `clean-param` is not a known field.