dogain.com
robots.txt

Robots Exclusion Standard data for dogain.com

Resource Scan

Scan Details

Site Domain dogain.com
Base Domain dogain.com
Scan Status Ok
Last Scan2024-09-10T21:29:03+00:00
Next Scan 2024-10-10T21:29:03+00:00

Last Scan

Scanned2024-09-10T21:29:03+00:00
URL http://www.dogain.com/robots.txt
Redirect https://www.dogain.com/robots.txt
Domain IPs 18.155.68.123, 18.155.68.35, 18.155.68.42, 18.155.68.93, 2600:9000:23d2:1000:b:6c08:5340:93a1, 2600:9000:23d2:2000:b:6c08:5340:93a1, 2600:9000:23d2:2800:b:6c08:5340:93a1, 2600:9000:23d2:3e00:b:6c08:5340:93a1, 2600:9000:23d2:6000:b:6c08:5340:93a1, 2600:9000:23d2:6200:b:6c08:5340:93a1, 2600:9000:23d2:9600:b:6c08:5340:93a1, 2600:9000:23d2:9800:b:6c08:5340:93a1
Response IP 18.155.68.42
Found Yes
Hash b428901578d2fab8695b27e65b104d585bbcf21056b33646ae1cfee68390c1fc
SimHash 75849ddd0f11

Groups

*

Rule Path
Disallow /m-login
Disallow /ce_make.html
Disallow /cyproductlist_1/
Disallow /verify.html

baiduspider/2.0

Rule Path
Disallow /producer/
Disallow /thirdcode/
Disallow /nportal/
Disallow /icp
Disallow *api*
Disallow *.php
Disallow *.asp
Disallow /admin/
Disallow /npublic/
Disallow /thirdcode/
Disallow /site.txt

Other Records

Field Value
sitemap https://www.dogain.com/sitemap.xml