hondasxs.com
robots.txt

Robots Exclusion Standard data for hondasxs.com

Resource Scan

Scan Details

Site Domain hondasxs.com
Base Domain hondasxs.com
Scan Status Ok
Last Scan2024-05-28T16:11:07+00:00
Next Scan 2024-06-04T16:11:07+00:00

Last Scan

Scanned2024-05-28T16:11:07+00:00
URL https://hondasxs.com/robots.txt
Domain IPs 172.66.40.203, 172.66.43.53, 2606:4700:3108::ac42:28cb, 2606:4700:3108::ac42:2b35
Response IP 172.66.43.53
Found Yes
Hash ae4c95892cce6ba1842c33eb1edf0eedc95562033037608c736abbbe406e4c9f
SimHash 005542464f03

Groups

*

Rule Path
Disallow /data/avatars/*

mediapartners-google

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

baidu

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

linkdexbot-mobile

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

spbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

urlappendbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

*

Rule Path
Disallow /?page=
Disallow /account/
Disallow /goto/
Disallow /posts/
Disallow /login/
Disallow /admin.php
Disallow /members/
Disallow /conversations/
Disallow /search/
Allow /

Other Records

Field Value
sitemap http://hondasxs.com/sitemap.php