desenvolvedor.expert
robots.txt

Robots Exclusion Standard data for desenvolvedor.expert

Resource Scan

Scan Details

Site Domain desenvolvedor.expert
Base Domain desenvolvedor.expert
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-08-07T19:20:39+00:00
Next Scan 2025-09-06T19:20:39+00:00

Last Successful Scan

Scanned2025-07-01T18:51:26+00:00
URL https://desenvolvedor.expert/robots.txt
Redirect https://desenvolvedor.expert/robots.txt?gi=9d3f1553d83b
Domain IPs 52.0.16.118, 52.1.119.170, 52.1.147.205, 52.1.173.203, 52.4.145.119, 52.4.175.111, 52.4.225.124, 52.4.240.221, 52.4.38.70, 52.5.181.79, 52.6.3.192, 52.6.46.142
Response IP 52.5.181.79
Found Yes
Hash d27434de84122ebf610fc2e91f892d0bd986132e37b4be46c96f6b1ef9f458dd
SimHash 6938bb844672

Groups

*

Rule Path
Disallow /m/
Disallow /me/
Disallow /%40me$
Disallow /%40me/
Disallow /*/edit$
Disallow /*/*/edit$
Disallow /media/
Disallow /p/*/share
Disallow /r/
Disallow /trending
Disallow /search?q$
Disallow /search?q=
Disallow /*/search?q=
Disallow /*/search/*?q=
Disallow /*/*source%3D
Allow /_/
Allow /_/api/users/*/meta
Allow /_/api/users/*/profile/stream
Allow /_/api/posts/*/responses
Allow /_/api/posts/*/responsesStream
Allow /_/api/posts/*/related

applebot-extended
bytespider
claudebot
facebookbot
googleother
gptbot

Rule Path
Disallow /
Allow /about
Allow /business
Allow /earn
Allow /gift
Allow /membership
Allow /partner-program
Allow /verified-authors

Other Records

Field Value
sitemap https://desenvolvedor.expert/sitemap/sitemap.xml

Warnings

  • `license` is not a known field.