cdn.icon-icons.com
robots.txt

Robots Exclusion Standard data for cdn.icon-icons.com

Resource Scan

Scan Details

Site Domain cdn.icon-icons.com
Base Domain icon-icons.com
Scan Status Ok
Last Scan2024-09-07T10:09:38+00:00
Next Scan 2024-10-07T10:09:38+00:00

Last Scan

Scanned2024-09-07T10:09:38+00:00
URL https://cdn.icon-icons.com/robots.txt
Domain IPs 104.26.12.212, 104.26.13.212, 172.67.72.210, 2606:4700:20::681a:cd4, 2606:4700:20::681a:dd4, 2606:4700:20::ac43:48d2
Response IP 172.67.72.210
Found Yes
Hash aa3343650e975932217c4e32e6de95505f83692aa24b882b0057d21be542027a
SimHash 245ecb44a43b

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /istock/
Disallow /login/
Disallow /es/login/
Disallow /fr/login/
Disallow /de/login/
Disallow /it/login/
Disallow /pt/login/
Disallow /ru/login/
Disallow /nl/login/
Disallow /zh/login/
Disallow /ja/login/
Disallow /ko/login/
Disallow /id/login/
Disallow /th/login/
Disallow /ar/login/
Disallow /register/
Disallow /es/register/
Disallow /fr/register/
Disallow /de/register/
Disallow /it/register/
Disallow /pt/register/
Disallow /ru/register/
Disallow /nl/register/
Disallow /zh/register/
Disallow /ja/register/
Disallow /ko/register/
Disallow /id/register/
Disallow /th/register/
Disallow /ar/register/

mj12bot
sitebot
dotbot
ahrefsbot
ahrefssiteaudit
ocelli
sistrix
shopwiki
wbsearchbot
riddlerbot
linguatools
www.integromedb.org/crawler
ccbot
grapeshotcrawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://icon-icons.com/sitemaps/indice_sitemap_imagenes.xml

Comments

  • User-agent: Baiduspider
  • User-agent: baiduspider
  • User-agent: Baiduspider+
  • User-agent: Baiduspider-video
  • User-agent: Baiduspider-image

Warnings

  • 1 invalid line.