shdlgroup.com
robots.txt

Robots Exclusion Standard data for shdlgroup.com

Resource Scan

Scan Details

Site Domain shdlgroup.com
Base Domain shdlgroup.com
Scan Status Ok
Last Scan2024-05-29T05:04:46+00:00
Next Scan 2024-06-28T05:04:46+00:00

Last Scan

Scanned2024-05-29T05:04:46+00:00
URL http://www.shdlgroup.com/robots.txt
Domain IPs 13.226.123.119, 13.226.123.149, 13.226.123.222, 13.226.123.83, 2600:9000:23d2:2600:b:e916:b8c0:21, 2600:9000:23d2:3600:b:e916:b8c0:21, 2600:9000:23d2:600:b:e916:b8c0:21, 2600:9000:23d2:7000:b:e916:b8c0:21, 2600:9000:23d2:7800:b:e916:b8c0:21, 2600:9000:23d2:9600:b:e916:b8c0:21, 2600:9000:23d2:9e00:b:e916:b8c0:21, 2600:9000:23d2:a400:b:e916:b8c0:21
Response IP 18.155.70.36
Found Yes
Hash 1836662515cc5376b10a15b6b13e37df3ef1f6579ef8ac17e23e29b81987e270
SimHash 75848ddc8d11

Groups

*

Rule Path
Disallow /m-login
Disallow /ce_make.html
Disallow /cyproductlist_1/
Disallow /verify.html

baiduspider/2.0

Rule Path
Disallow /producer/
Disallow /thirdcode/
Disallow /nportal/
Disallow /icp
Disallow *api*
Disallow *.php
Disallow *.asp
Disallow /admin/
Disallow /npublic/
Disallow /thirdcode/
Disallow /site.txt

Other Records

Field Value
sitemap http://www.shdlgroup.com/sitemap.xml