ipartsexpert.com
robots.txt

Robots Exclusion Standard data for ipartsexpert.com

Resource Scan

Scan Details

Site Domain ipartsexpert.com
Base Domain ipartsexpert.com
Scan Status Ok
Last Scan2024-05-28T08:43:11+00:00
Next Scan 2024-06-27T08:43:11+00:00

Last Scan

Scanned2024-05-28T08:43:11+00:00
URL https://www.ipartsexpert.com/robots.txt
Domain IPs 104.21.1.129, 172.67.129.66, 2606:4700:3033::6815:181, 2606:4700:3037::ac43:8142
Response IP 172.67.129.66
Found Yes
Hash cf45b1f219554f6d7f122ef923c5567b49e45957e9cbd478144b311961bb3670
SimHash b866f176c143

Groups

*

Rule Path
Disallow

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

Comments

  • close the door

Warnings

  • 2 invalid lines.