blog.redturtle.it
robots.txt

Robots Exclusion Standard data for blog.redturtle.it

Resource Scan

Scan Details

Site Domain blog.redturtle.it
Base Domain redturtle.it
Scan Status Ok
Last Scan2025-06-19T14:57:23+00:00
Next Scan 2025-07-19T14:57:23+00:00

Last Scan

Scanned2025-06-19T14:57:23+00:00
URL https://blog.redturtle.it/robots.txt
Redirect https://medium.redturtle.it/robots.txt?gi=26f4f6870b5b
Redirect Domain medium.redturtle.it
Redirect Base redturtle.it
Domain IPs 65.21.34.14
Redirect IPs 52.0.16.118, 52.1.119.170, 52.1.147.205, 52.1.173.203, 52.4.145.119, 52.4.175.111, 52.4.225.124, 52.4.240.221, 52.4.38.70, 52.5.181.79, 52.6.3.192, 52.6.46.142
Response IP 52.6.46.142
Found Yes
Hash 36f4cdd532d5ad19910b98f14e1e85855979ebd9f44486b73f6f7629fbf8547b
SimHash 691c3b444772

Groups

*

Rule Path
Disallow /m/
Disallow /me/
Disallow /%40me$
Disallow /%40me/
Disallow /*/edit$
Disallow /*/*/edit$
Disallow /media/
Disallow /p/*/share
Disallow /r/
Disallow /trending
Disallow /search?q$
Disallow /search?q=
Disallow /*/search?q=
Disallow /*/search/*?q=
Disallow /*/*source%3D
Allow /_/
Allow /_/api/users/*/meta
Allow /_/api/users/*/profile/stream
Allow /_/api/posts/*/responses
Allow /_/api/posts/*/responsesStream
Allow /_/api/posts/*/related

applebot-extended
bytespider
claudebot
facebookbot
googleother
google-extended
gptbot

Rule Path
Disallow /
Allow /about
Allow /business
Allow /earn
Allow /gift
Allow /membership
Allow /partner-program
Allow /verified-authors

Other Records

Field Value
sitemap https://medium.redturtle.it/sitemap/sitemap.xml

Warnings

  • `license` is not a known field.