hubimg.com
robots.txt

Robots Exclusion Standard data for hubimg.com

Resource Scan

Scan Details

Site Domain hubimg.com
Base Domain hubimg.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-07-02T15:54:54+00:00
Next Scan 2024-09-30T15:54:54+00:00

Last Successful Scan

Scanned2023-08-14T11:19:58+00:00
URL http://hubimg.com/robots.txt
Redirect https://hubpages.com:443/robots.txt
Redirect Domain hubpages.com
Redirect Base hubpages.com
Domain IPs 34.206.185.230, 44.194.180.146
Redirect IPs 18.210.249.37, 52.1.184.208
Response IP 52.1.184.208
Found Yes
Hash 5f5766bb2c821aea1a9c69cc9393069b0528e3dcb1ce5907f3e9776cfee3dca8
SimHash 40a4dcd09601

Groups

*

Rule Path
Disallow /email/
Disallow /c/
Disallow /docs/
Disallow /my/
Disallow /make/request/
Disallow /profile/*/map$
Disallow /search/
Disallow /hop/
Disallow /tip/
Disallow /answers/
Disallow /slide/
Disallow /clean/
Disallow /sharehub/
Disallow /forum/post/report/
Disallow /dip/
Disallow /redir/

googlebot

Rule Path
Disallow /email/
Disallow /c/
Disallow /docs/
Disallow /my/
Disallow /make/request/
Disallow /profile/*/map$
Disallow /search/
Disallow /hop/
Disallow /tip/
Disallow /answers/
Disallow /slide/
Disallow /clean/
Disallow /sharehub/
Disallow /forum/post/report/
Disallow /dip/
Disallow /1027454/
Disallow /signin/checkcookie

mediapartners-google

Rule Path
Disallow

covario-ids

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

owlin

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

xovibot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

magpie-crawler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://hubpages.com/sitemaps/hub/current/sitemap_index.xml
sitemap https://hubpages.com/sitemaps/forum/current/sitemap_index.xml
sitemap https://hubpages.com/sitemaps/user/current/sitemap_index.xml

Warnings

  • `noindex` is not a known field.