co-nss.co.jp
robots.txt

Robots Exclusion Standard data for co-nss.co.jp

Resource Scan

Scan Details

Site Domain co-nss.co.jp
Base Domain co-nss.co.jp
Scan Status Ok
Last Scan2024-10-28T09:31:01+00:00
Next Scan 2024-11-27T09:31:01+00:00

Last Scan

Scanned2024-10-28T09:31:01+00:00
URL https://www.co-nss.co.jp/robots.txt
Domain IPs 133.18.78.74
Response IP 133.18.78.74
Found Yes
Hash 686665a7b7b27d930a471c361df72cf98b3b3c21a20fff19f71b90ba88df5212
SimHash 185ed970ae9b

Groups

*

Rule Path
Disallow /sitemap.html/
Disallow /sitemap/

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

steeler

Rule Path
Disallow /

mappy

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.co-nss.co.jp/sitemap.xml

Warnings

  • 2 invalid lines.