bitauto.com
robots.txt

Robots Exclusion Standard data for bitauto.com

Resource Scan

Scan Details

Site Domain bitauto.com
Base Domain bitauto.com
Scan Status Ok
Last Scan2024-09-05T19:03:35+00:00
Next Scan 2024-10-05T19:03:35+00:00

Last Scan

Scanned2024-09-05T19:03:35+00:00
URL https://bitauto.com/robots.txt
Redirect https://www.bitauto.com/robots.txt
Redirect Domain www.bitauto.com
Redirect Base bitauto.com
Domain IPs 18.155.68.128, 18.155.68.35, 18.155.68.73, 18.155.68.9, 2600:9000:23d2:5600:a:4ec4:5e40:93a1, 2600:9000:23d2:9200:a:4ec4:5e40:93a1, 2600:9000:23d2:c600:a:4ec4:5e40:93a1, 2600:9000:23d2:e800:a:4ec4:5e40:93a1, 2600:9000:23d2:ea00:a:4ec4:5e40:93a1, 2600:9000:23d2:f600:a:4ec4:5e40:93a1, 2600:9000:23d2:f800:a:4ec4:5e40:93a1, 2600:9000:23d2:fc00:a:4ec4:5e40:93a1
Redirect IPs 2600:9000:2721:2000:1a:c250:9a40:93a1, 2600:9000:2721:2a00:1a:c250:9a40:93a1, 2600:9000:2721:5c00:1a:c250:9a40:93a1, 2600:9000:2721:6e00:1a:c250:9a40:93a1, 2600:9000:2721:800:1a:c250:9a40:93a1, 2600:9000:2721:9600:1a:c250:9a40:93a1, 2600:9000:2721:a00:1a:c250:9a40:93a1, 2600:9000:2721:f400:1a:c250:9a40:93a1, 3.165.102.28, 3.165.102.37, 3.165.102.72, 3.165.102.79
Response IP 3.165.102.79
Found Yes
Hash 1b2b0e5d67bc2324827bc0e51102cbb9d6f2139029db70b8d27f9da53e66c621
SimHash 00408b704313

Groups

*

Rule Path
Disallow /topics/
Disallow /zhuanti/
Disallow /foreweb/
Allow /