utsource.net
robots.txt

Robots Exclusion Standard data for utsource.net

Resource Scan

Scan Details

Site Domain utsource.net
Base Domain utsource.net
Scan Status Ok
Last Scan2024-05-19T19:59:57+00:00
Next Scan 2024-06-18T19:59:57+00:00

Last Scan

Scanned2024-05-19T19:59:57+00:00
URL https://utsource.net/robots.txt
Redirect https://www.utsource.net/robots.txt
Redirect Domain www.utsource.net
Redirect Base utsource.net
Domain IPs 47.88.62.95
Redirect IPs 163.181.87.240, 2409:8744:300:b2:3::3fc
Response IP 163.181.160.240
Found Yes
Hash cf5497cf2800701f0df9bd318750c996b06f52d6db657dea837b58a50b13017d
SimHash 0a1c5457cc4b

Groups

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

facebookexternalhit/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

sogou spider

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

soso

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

yodao

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

nhn

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

*

Rule Path
Disallow /api/
Disallow /cust/
Disallow /Account/
Disallow /Error/
Disallow /Pay/
Disallow /Order/
Disallow /AfterSale/
Disallow /category/accessories-tools/health-care
Disallow /home/healthcare

Other Records

Field Value
sitemap https://www.utsource.net/sitemap.xml