utsource.net
robots.txt
Robots Exclusion Standard data for utsource.net
Resource Scan
Scan Details
Site Domain | utsource.net |
Base Domain | utsource.net |
Scan Status | Ok |
Last Scan | 2024-05-19T19:59:57+00:00 |
Next Scan | 2024-06-18T19:59:57+00:00 |
Last Scan
Scanned | 2024-05-19T19:59:57+00:00 |
URL | https://utsource.net/robots.txt |
Redirect | https://www.utsource.net/robots.txt |
Redirect Domain | www.utsource.net |
Redirect Base | utsource.net |
Domain IPs | 47.88.62.95 |
Redirect IPs | 163.181.87.240, 2409:8744:300:b2:3::3fc |
Response IP | 163.181.160.240 |
Found | Yes |
Hash | cf5497cf2800701f0df9bd318750c996b06f52d6db657dea837b58a50b13017d |
SimHash | 0a1c5457cc4b |
Groups
facebookexternalhit/1.1
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
*
Rule | Path |
---|---|
Disallow | /api/ |
Disallow | /cust/ |
Disallow | /Account/ |
Disallow | /Error/ |
Disallow | /Pay/ |
Disallow | /Order/ |
Disallow | /AfterSale/ |
Disallow | /category/accessories-tools/health-care |
Disallow | /home/healthcare |
Other Records
Field | Value |
---|---|
sitemap | https://www.utsource.net/sitemap.xml |