bloggers.feedspot.com
robots.txt

Robots Exclusion Standard data for bloggers.feedspot.com

Resource Scan

Scan Details

Site Domain bloggers.feedspot.com
Base Domain feedspot.com
Scan Status Ok
Last Scan2025-08-10T00:50:14+00:00
Next Scan 2025-08-17T00:50:14+00:00

Last Scan

Scanned2025-08-10T00:50:14+00:00
URL https://bloggers.feedspot.com/robots.txt
Domain IPs 13.35.202.32, 13.35.202.48, 13.35.202.57, 13.35.202.75, 2600:9000:2078:1c00:d:f873:be00:93a1, 2600:9000:2078:3800:d:f873:be00:93a1, 2600:9000:2078:5400:d:f873:be00:93a1, 2600:9000:2078:9400:d:f873:be00:93a1, 2600:9000:2078:9a00:d:f873:be00:93a1, 2600:9000:2078:a400:d:f873:be00:93a1, 2600:9000:2078:c200:d:f873:be00:93a1, 2600:9000:2078:e000:d:f873:be00:93a1
Response IP 13.35.202.75
Found Yes
Hash 0978d989bb02e7d32e7669d0a0be5ab260880b3f38cebad55988619d95eb9c80
SimHash 07574608f2d2

Groups

*

Rule Path
Disallow /suggest/?*

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bytespider

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow /

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /folder/
Disallow /u/
Disallow /rsscombiner/
Disallow /brandmonitoring/
Disallow /widgets/
Disallow /cgi-bin/
Disallow /wp-admin
Disallow /wp-config*
Disallow /wp-content/themes/*.php
Disallow /wp-login.php
Disallow /*.asp*
Disallow /*.cfm
Disallow /*.cgi
Disallow /*.%7Cjsp*
Disallow /*.pl
Disallow /*.py

Comments

  • This space intentionally left blank
  • If you want to learn about why our robots.txt looks like this, read this post: https://yoa.st/robots-txt