softco.com
robots.txt

Robots Exclusion Standard data for softco.com

Resource Scan

Scan Details

Site Domain softco.com
Base Domain softco.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-09T07:52:26+00:00
Next Scan 2024-06-08T07:52:26+00:00

Last Successful Scan

Scanned2024-01-18T07:50:56+00:00
URL https://softco.com/robots.txt
Domain IPs 13.33.88.109, 13.33.88.129, 13.33.88.18, 13.33.88.25
Response IP 54.230.112.103
Found Yes
Hash 423a929bcc7981a2f09168c3fc481984aa5643229b0506c2ef7717e21e14e878
SimHash 13191a1288a5

Groups

*

Rule Path Comment
Disallow /wp-admin/ block access to the wp-admin folder
Disallow /flash-demo/ block access to the flash-demo folder
Disallow /ie/flash-demo/ block access to the ie flash-demo folder
Disallow /uk/flash-demo/ block access to the uk flash-demo folder
Disallow /10-6-product-update/ block access to the 10-6-product-update folder
Disallow /ie/10-6-product-update/ block access to the ie 10-6-product-update folder
Disallow /uk/10-6-product-update/ block access to the uk 10-6-product-update folder
Disallow /*.pdf$ block access to pdf files
Disallow /*.doc$ block access to doc files
Disallow /*.docx$ block access to docx files
Disallow /*.rtf$ block access to rtf files
Disallow /*.xls$ block access to xls files
Disallow /*.xlsx$ block access to xlsx files
Disallow /*.ppt$ block access to ppt files
Disallow /*.pptx$ block access to pptx files
Disallow *?s=* block access to internal search result pages
Disallow *?p=* block access to pages for which permalinks fails
Disallow *%26p%3D* block access to pages for which permalinks fails
Disallow *%26preview%3D* block access to preview pages

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://softco.com/sitemap_index.xml