rainforest.tech
robots.txt

Robots Exclusion Standard data for rainforest.tech

Resource Scan

Scan Details

Site Domain rainforest.tech
Base Domain rainforest.tech
Scan Status Ok
Last Scan2026-02-09T09:26:06+00:00
Next Scan 2026-03-11T09:26:06+00:00

Last Scan

Scanned2026-02-09T09:26:06+00:00
URL https://rainforest.tech/robots.txt
Domain IPs 172.66.41.45, 172.66.42.211, 2606:4700:3108::ac42:292d, 2606:4700:3108::ac42:2ad3
Response IP 172.66.41.45
Found Yes
Hash 50d48a1d4aa7326bba13a4a8c28a4f0bfd000bf89b541c944e04a53591d6eebe
SimHash 6b109900e28a

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-admin
Disallow /dorflex
Disallow /trackback/
Disallow /wp-content/plugins
Disallow /wp-content/themes
Disallow /xmlrpc.php
Disallow /search
Disallow /support/search.php
Disallow /extend/plugins/search.php
Disallow /plugins/search.php
Disallow /extend/themes/search.php
Disallow /themes/search.php
Disallow /support/rss
Disallow /archive/
Disallow /cgi-bin
Disallow /tags/
Disallow /page/
Disallow /tag/
Disallow */trackback
Disallow /*/*?s=*
Allow /wp-admin/admin-ajax.php

gptbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

siteauditbot

Rule Path
Allow /

semrushbot-ba

Rule Path
Allow /

semrushbot-si

Rule Path
Allow /

semrushbot-swa

Rule Path
Allow /

semrushbot-ct

Rule Path
Allow /

splitsignalbot

Rule Path
Allow /

semrushbot-coub

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.rainforest.tech/sitemap_index.xml
sitemap https://www.rainforest.tech/post-sitemap.xml
sitemap https://www.rainforest.tech/page-sitemap.xml
sitemap https://www.rainforest.tech/category-sitemap.xml
sitemap https://www.rainforest.tech/post_tag-sitemap.xml

Warnings

  • 1 invalid line.