merinobadiola.dev
robots.txt

Robots Exclusion Standard data for merinobadiola.dev

Resource Scan

Scan Details

Site Domain merinobadiola.dev
Base Domain merinobadiola.dev
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-31T13:15:27+00:00
Next Scan 2025-11-29T13:15:27+00:00

Last Successful Scan

Scanned2025-01-27T05:29:28+00:00
URL https://merinobadiola.dev/robots.txt
Redirect https://merinobadiola.dev/robots.txt?gi=3156bf941a9b
Domain IPs 162.159.152.4, 162.159.153.4
Response IP 162.159.153.4
Found Yes
Hash 003747837a27a7ab0596fc766c41a322cb369a56dee3fcab9cd85475399ea8fa
SimHash 6804ba61c773

Groups

*

Rule Path
Disallow /m/
Disallow /me/
Disallow /%40me$
Disallow /%40me/
Disallow /*/edit$
Disallow /*/*/edit$
Disallow /r/
Disallow /t/
Disallow /search?q$
Disallow /search?q=
Disallow /*/*source%3D
Allow /_/
Allow /_/api/users/*/meta
Allow /_/api/users/*/profile/stream
Allow /_/api/posts/*/responses
Allow /_/api/posts/*/responsesStream
Allow /_/api/posts/*/related

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://merinobadiola.dev/sitemap/sitemap.xml