s.cdn-care.com
robots.txt

Robots Exclusion Standard data for s.cdn-care.com

Resource Scan

Scan Details

Site Domain s.cdn-care.com
Base Domain cdn-care.com
Scan Status Ok
Last Scan2024-06-18T02:00:17+00:00
Next Scan 2024-07-02T02:00:17+00:00

Last Scan

Scanned2024-06-18T02:00:17+00:00
URL https://s.cdn-care.com/robots.txt
Domain IPs 23.52.40.59, 23.52.40.74
Response IP 96.17.180.48
Found Yes
Hash 20e79e1abbd344ed067de0e1c60f7d61770092578f453aedd01db597d95bdbf6
SimHash 6b10da32e220

Groups

*

Rule Path
Disallow /*/myaccount/
Disallow /ubertags/
Disallow /password
Disallow /trackVisit.trace
Disallow /verify-url
Disallow /us-marketplace/
Disallow /us-recruitment/
Disallow /us-senior-care/
Disallow /us-subscription/
Disallow /us-workplace-solutions/
Disallow /LitlePayPage
Disallow /visitor/popUpPhoto.do
Disallow /c/records/
Disallow /visitor/
Disallow /api/messages/*
Disallow *qs%3D1*
Disallow /seeker/
Disallow /app/enrollment/
Disallow /app/smb-profile/
Disallow /app/hp-enrollment/
Disallow */captureUnifiedSearch
Disallow */app/seo/*
Disallow */app/sem/*
Allow /app/pn-business
Allow /app/enrollment/seeker/cc/tax-calculator
Allow /app/hp-vhp/

searchmetricsbot

Rule Path
Disallow /my-account/
Disallow /ubertags/
Disallow /login
Disallow /password

Other Records

Field Value
crawl-delay 3

adsbot-google

Rule Path
Allow *qs%3D1*
Allow */app/sem/*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

gaisbot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bytedance

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bytespider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.care.com/alpha-omega-jobs.xml
sitemap https://www.care.com/alpha-omega.xml
sitemap https://www.care.com/alpha-omega-theta-cost-guide.xml

Warnings

  • 2 invalid lines.