rslsoapbox.com
robots.txt

Robots Exclusion Standard data for rslsoapbox.com

Resource Scan

Scan Details

Site Domain rslsoapbox.com
Base Domain rslsoapbox.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-05-10T06:44:07+00:00
Next Scan 2024-08-08T06:44:07+00:00

Last Successful Scan

Scanned2024-01-12T01:25:49+00:00
URL https://rslsoapbox.com/robots.txt
Redirect https://www.rslsoapbox.com/robots.txt
Redirect Domain www.rslsoapbox.com
Redirect Base rslsoapbox.com
Domain IPs 151.101.130.125, 151.101.194.125, 151.101.2.125, 151.101.66.125
Redirect IPs 151.101.130.125, 151.101.194.125, 151.101.2.125, 151.101.66.125
Response IP 199.232.46.125
Found Yes
Hash 642579c6058010d176f61d4650bb7c5ebbdb8aa2be6b0e73c8cc487449589478
SimHash 2208dca2a7f3

Groups

googlebot-news

Rule Path
Disallow /admin
Disallow /newfanshot
Disallow /users/*/replies
Disallow /users/*/comments
Disallow /search
Disallow /account
Disallow /login
Disallow /chorus_auth
Disallow /sso
Disallow /ad
Disallow /sponsored
Allow /blogs
Allow /blog-
Allow /*-blog
Allow /*blog-

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow /admin
Disallow /newfanshot
Disallow /users/*/replies
Disallow /users/*/comments
Disallow /search
Disallow /account
Disallow /login
Disallow /chorus_auth
Disallow /sso
Allow /blogs
Allow /blog-
Allow /*-blog
Allow /*blog-

Other Records

Field Value
sitemap https://www.rslsoapbox.com/sitemaps
sitemap https://www.rslsoapbox.com/sitemaps/authors
sitemap https://www.rslsoapbox.com/sitemaps/groups
sitemap https://www.rslsoapbox.com/sitemaps/videos
sitemap https://www.rslsoapbox.com/sitemaps/google_news