uoa.custhelp.com
robots.txt

Robots Exclusion Standard data for uoa.custhelp.com

Resource Scan

Scan Details

Site Domain uoa.custhelp.com
Base Domain custhelp.com
Scan Status Ok
Last Scan2024-11-03T10:45:28+00:00
Next Scan 2024-12-03T10:45:28+00:00

Last Scan

Scanned2024-11-03T10:45:28+00:00
URL https://uoa.custhelp.com/robots.txt
Domain IPs 129.148.159.167
Response IP 129.148.159.167
Found Yes
Hash 11573588da8c309da3e03404e997326414e0b49a72e2e8e2e7c00c287db87155
SimHash 6edfda41c405

Groups

gsa-crawler

Product Comment
gsa-crawler CUSTOM
Rule Path Comment
Disallow CUSTOM

swiftbot

Product Comment
swiftbot CUSTOM
Rule Path Comment
Disallow CUSTOM

ibm-appconnect/v1

Product Comment
ibm-appconnect/v1 CUSTOM
Rule Path Comment
Disallow CUSTOM

googlebot

Product Comment
googlebot Google # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

msnbot

Product Comment
msnbot MSN # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

Other Records

Field Value Comment
crawl-delay 0.2 ADDED BY HMS

slurp

Product Comment
slurp Yahoo! # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

Other Records

Field Value Comment
crawl-delay 0.2 ADDED BY HMS

teoma

Product Comment
teoma Ask.com # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

bingbot

Product Comment
bingbot Bing # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

*

Product Comment
* ADDED BY HMS
Rule Path Comment
Disallow / ADDED BY HMS

Other Records

Field Value Comment
sitemap https://uoa.custhelp.com/ci/sitemap/ ADDED BY HMS

Comments

  • CUSTOM
  • CUSTOM
  • CUSTOM
  • CUSTOM
  • CUSTOM
  • CUSTOM