damcogroup.com
robots.txt

Robots Exclusion Standard data for damcogroup.com

Resource Scan

Scan Details

Site Domain damcogroup.com
Base Domain damcogroup.com
Scan Status Ok
Last Scan2024-09-20T09:57:26+00:00
Next Scan 2024-10-20T09:57:26+00:00

Last Scan

Scanned2024-09-20T09:57:26+00:00
URL https://damcogroup.com/robots.txt
Redirect https://www.damcogroup.com/robots.txt
Redirect Domain www.damcogroup.com
Redirect Base damcogroup.com
Domain IPs 13.234.255.133
Redirect IPs 13.234.255.133
Response IP 13.234.255.133
Found Yes
Hash 8dd71ba5481fa5f57cf5bdc6e7e96f66a6bec1e1e7c33d0debf8da2db4c0d585
SimHash c807595a4f90

Groups

*

Rule Path
Disallow /feed/
Disallow /tag/
Disallow /lp/
Disallow /itesinsights/tag/
Disallow /blogs/tag/
Disallow /blogs/page/
Disallow /sitemap.html
Disallow /amritdhara/
Disallow /webinar/
Disallow *.pdf
Disallow /author/
Disallow /insurance/lastest-three-insurance-blog/
Disallow /insurance/?s
Disallow /insurance-latest-resources
Disallow /latest-insurance-resources-new
Disallow /salesforce/resource-category/success_stories/
Disallow /insights/

rytebot
onpagebot
dotbot
rogerbot
mj12bot
dataforseobot
petalbot
seokicks
awariorssbot
awariosmartbot
serendeputybot
mojeekbot
scrapy
orbbot
mauibot
neevabot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.damcogroup.com/sitemap.xml

Comments

  • Blocked crawlers