cvdesigner.in
robots.txt

Robots Exclusion Standard data for cvdesigner.in

Resource Scan

Scan Details

Site Domain cvdesigner.in
Base Domain cvdesigner.in
Scan Status Ok
Last Scan2026-02-01T19:10:24+00:00
Next Scan 2026-03-03T19:10:24+00:00

Last Scan

Scanned2026-02-01T19:10:24+00:00
URL https://cvdesigner.in/robots.txt
Redirect https://www.cvdesigner.in/robots.txt
Redirect Domain www.cvdesigner.in
Redirect Base cvdesigner.in
Domain IPs 2a02:4780:16:11a5:efaf:b5b9:4568:6361, 2a02:4780:38:d20b:debc:db28:be41:193e, 84.32.84.135, 84.32.84.62
Redirect IPs 179.61.189.226, 2a02:4780:84:61ff:cb22:2849:8b49:73b9, 2a02:4780:84:e978:22c3:3c37:88c8:aa75, 77.37.48.136
Response IP 91.108.100.121
Found Yes
Hash 9bbc840d31338fea45f8b1e3137d9a6ee4878949a4e8063dad28caf5d852614c
SimHash 25144f02e695

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /cgi-bin/
Disallow /private/
Disallow /temp/
Disallow /uploads/temp/
Disallow /*?*
Disallow /checkout/
Disallow /cart/
Disallow /login/
Disallow /register/
Disallow /password-reset/
Disallow /my-account/
Disallow /order/

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

bingbot

Rule Path
Allow /

yandex

Rule Path
Allow /

baiduspider

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

facebookbot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.cvdesigner.in/sitemap.xml

Comments

  • robots.txt for cvdesigner.in
  • Resume Design | CV Templates | Professional Resume Formatting
  • Last Updated: December 2025
  • Major Search Engines
  • AI Crawlers
  • Social Media Bots
  • SEO Tools (with crawl delay to prevent server load)
  • Sitemaps - Use WWW version for consistency