creditinfocenter.com
robots.txt

Robots Exclusion Standard data for creditinfocenter.com

Resource Scan

Scan Details

Site Domain creditinfocenter.com
Base Domain creditinfocenter.com
Scan Status Ok
Last Scan2024-11-16T06:00:19+00:00
Next Scan 2024-11-23T06:00:19+00:00

Last Scan

Scanned2024-11-16T06:00:19+00:00
URL https://creditinfocenter.com/robots.txt
Domain IPs 35.212.57.127
Response IP 35.212.57.127
Found Yes
Hash 86b222d5b3d9d0664c65c80fef06478b21cf28f7da84adffe61a36cb314a3251
SimHash c8308890c598

Groups

*

Rule Path
Disallow /community/startTopic/
Disallow /community/discover/unread/
Disallow /community/markallread/
Disallow /community/staff/
Disallow /community/online/
Disallow /community/discover/
Disallow /community/leaderboard/
Disallow /community/search/
Disallow /community/*?advancedSearchForm=
Disallow /community/register/
Disallow /community/lostpassword/
Disallow /community/login/
Disallow /community/*?sortby=
Disallow /community/*?filter=
Disallow /community/*?tab=
Disallow /community/*?do=
Disallow /community/*ref%3D
Disallow /community/profile/

Other Records

Field Value
sitemap https://www.creditinfocenter.com/community/sitemap.php

Comments

  • Rules for CreditInfoCenter Community (https://www.creditinfocenter.com/community/)
  • Block pages with no unique content
  • Block faceted pages and 301 redirect pages
  • Block profile pages as these have little unique value, consume a lot of crawl time and contain hundreds of 301 links
  • Sitemap URL