pembrokechrysler.com
robots.txt

Robots Exclusion Standard data for pembrokechrysler.com

Resource Scan

Scan Details

Site Domain pembrokechrysler.com
Base Domain pembrokechrysler.com
Scan Status Ok
Last Scan2024-05-11T08:16:23+00:00
Next Scan 2024-06-10T08:16:23+00:00

Last Scan

Scanned2024-05-11T08:16:23+00:00
URL https://pembrokechrysler.com/robots.txt
Redirect https://www.pembrokechrysler.com/robots.txt
Redirect Domain www.pembrokechrysler.com
Redirect Base pembrokechrysler.com
Domain IPs 13.33.165.22
Redirect IPs 2600:9000:20a6:4000:a:9d3e:bb80:93a1, 2600:9000:20a6:5400:a:9d3e:bb80:93a1, 2600:9000:20a6:8000:a:9d3e:bb80:93a1, 2600:9000:20a6:8600:a:9d3e:bb80:93a1, 2600:9000:20a6:a800:a:9d3e:bb80:93a1, 2600:9000:20a6:ae00:a:9d3e:bb80:93a1, 2600:9000:20a6:c400:a:9d3e:bb80:93a1, 2600:9000:20a6:fc00:a:9d3e:bb80:93a1, 99.84.238.139, 99.84.238.162, 99.84.238.196, 99.84.238.217
Response IP 18.165.171.11
Found Yes
Hash 073058f82db1f7e1bcbd9fdd31165ad2b4aceda77f566961e38cced23f81e829
SimHash 5b24d2024411

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /readme.html
Disallow /refer/
Disallow /data/
Disallow /db/
Disallow /scripts/
Disallow /tools/
Disallow /utils/
Disallow /vendor/
Disallow /fr/sitemap_index.xml
Disallow /en/sitemap_index.xml
Disallow *print/
Disallow *?window_sticker
Disallow *?gclid
Disallow /*.svg$
Disallow /wp-content/plugins/
Disallow /wp-content/mu-plugins/

mediapartners-google

Rule Path
Allow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou pic agent

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou-test-spider/4.0 (compatible; msie 5.5; windows 98)

Rule Path
Disallow /

sogou pic spider/3.0( http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou pic spider/3.0( http://www.sogou.com/docs/help/webmasters.htm 07)
Rule Path
Disallow /

sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm 07)
Rule Path
Disallow /

sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm 07)
Rule Path
Disallow /

sogou orion spider/3.0( http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou orion spider/3.0( http://www.sogou.com/docs/help/webmasters.htm 07)
Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.pembrokechrysler.com/sitemap_index.xml