kucingku.id
robots.txt

Robots Exclusion Standard data for kucingku.id

Resource Scan

Scan Details

Site Domain kucingku.id
Base Domain kucingku.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-04T01:55:48+00:00
Next Scan 2024-12-04T01:55:48+00:00

Last Successful Scan

Scanned2024-10-05T20:46:04+00:00
URL https://kucingku.id/robots.txt
Redirect https://www.kucingku.id/robots.txt
Redirect Domain www.kucingku.id
Redirect Base kucingku.id
Domain IPs 103.247.11.107, 2001:df0:27b:2::8:81e9
Redirect IPs 103.247.11.107, 2001:df0:27b:2::8:81e9
Response IP 103.247.11.107
Found Yes
Hash 0725fbd7e2ec19eed47d79eda628f2191d55a4cc38856428767dca4ed8ec143d
SimHash 401c56f1e73b

Groups

*

Rule Path
Disallow /wp-admin
Allow /wp-admin/admin-ajax.php

yandex
baiduspider
sogou web spider
mojeekbot
seznambot

Rule Path
Disallow /

applebot
garlikcrawler
mappy
cliqzbot
ltx71 - (http://ltx71.com/)
daum
grapeshot

Rule Path
Disallow /

special_archiver
proximic
blexbot
cula
velenpublicwebcrawler

Rule Path
Disallow /

facebookexternalhit
twitterbot
pinterestbot

Rule Path
Disallow /

semrushbot
ahrefsbot
mj12bot
spbot
extlinksbot
linkdexbot
serpstatbot

Rule Path
Disallow /

mail.ru_bot
mauibot
linguee bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.kucingku.id/sitemap_index.xml

Comments

  • Block Unwanted Search Engine Bots
  • Block Marketing Tools Bots
  • Block Web Stats Bots
  • Block Social Media Bots
  • Block SEO Tools Bots
  • Block Annoying Bots