kidsatvsale.com
robots.txt

Robots Exclusion Standard data for kidsatvsale.com

Resource Scan

Scan Details

Site Domain kidsatvsale.com
Base Domain kidsatvsale.com
Scan Status Ok
Last Scan2024-11-16T18:20:57+00:00
Next Scan 2024-11-23T18:20:57+00:00

Last Scan

Scanned2024-11-16T18:20:57+00:00
URL https://kidsatvsale.com/robots.txt
Domain IPs 69.164.198.18
Response IP 69.164.198.18
Found Yes
Hash 155be672863bbf373e8f225aaeaa44a6b546d395cf2d7d251f8e0397be3cac9f
SimHash 80b35b608b93

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /?s=*
Disallow /search/*
Disallow /map-location/
Allow /wp-admin/admin-ajax.php

turnitinbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

legs

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexwebmaster

Rule Path
Disallow /

yandex

Rule Path
Disallow /

speedy

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

spider

Rule Path
Disallow /

psbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

yeti

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

baidu

Rule Path
Disallow /

goo

Rule Path
Disallow /

majestic-seo

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

yandexwebmaster/2.0

Rule Path
Disallow /

java

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

voyager

Rule Path
Disallow /

scooter

Rule Path
Disallow /

robot

Rule Path
Disallow /

fido

Rule Path
Disallow /

motor

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

crawl

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

xenu

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.kidsatvsale.com/sitemap_index.xml

Comments

  • user-agent: AhrefsBot
  • disallow: /

Warnings

  • 4 invalid lines.