shiology.net
robots.txt

Robots Exclusion Standard data for shiology.net

Resource Scan

Scan Details

Site Domain shiology.net
Base Domain shiology.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2026-03-22T22:11:20+00:00
Next Scan 2026-06-20T22:11:20+00:00

Last Successful Scan

Scanned2025-11-08T02:21:57+00:00
URL https://shiology.net/robots.txt
Redirect https://shiology.net/robots.txt?gi=a308b147366b
Domain IPs 52.0.16.118, 52.1.119.170, 52.1.147.205, 52.1.173.203, 52.4.145.119, 52.4.175.111, 52.4.225.124, 52.4.240.221, 52.4.38.70, 52.5.181.79, 52.6.3.192, 52.6.46.142
Response IP 52.6.3.192
Found Yes
Hash bf11d099ba964625d018c6f9b200da15cceb29200b44b316c993314efc5d23ce
SimHash 693cbb414772

Groups

*

Rule Path
Disallow /m/
Disallow /me/
Disallow /%40me$
Disallow /%40me/
Disallow /*/edit$
Disallow /*/*/edit$
Disallow /media/
Disallow /p/*/share
Disallow /r/
Disallow /trending
Disallow /search?q$
Disallow /search?q=
Disallow /*/search?q=
Disallow /*/search/*?q=
Disallow /*/*source%3D
Allow /_/api/users/*/meta
Allow /_/api/users/*/profile/stream
Allow /_/api/posts/*/responses
Allow /_/api/posts/*/responsesStream
Allow /_/api/posts/*/related

amazonbot
applebot-extended
bytespider
claudebot
facebookbot
googleother
gptbot
meta-externalagent

Rule Path
Disallow /
Allow /about
Allow /business
Allow /earn
Allow /gift
Allow /membership
Allow /partner-program
Allow /verified-authors

Other Records

Field Value
sitemap https://shiology.net/sitemap/sitemap.xml

Warnings

  • `license` is not a known field.