deandorra.com
robots.txt

Robots Exclusion Standard data for deandorra.com

Resource Scan

Scan Details

Site Domain deandorra.com
Base Domain deandorra.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-07T05:34:19+00:00
Next Scan 2024-11-05T05:34:19+00:00

Last Successful Scan

Scanned2024-01-11T03:39:57+00:00
URL https://deandorra.com/robots.txt
Domain IPs 104.21.63.61, 172.67.143.223, 2606:4700:3030::6815:3f3d, 2606:4700:3030::ac43:8fdf
Response IP 104.21.63.61
Found Yes
Hash 827404f523ffb27a21c1035dae5606f85880e8b4241fc209fafb28e7fd6fcdbd
SimHash e3b471f8ecbb

Groups

*

Rule Path
Disallow /wp-admin/

*

Rule Path
Disallow /redirect?*
Disallow /wp-content/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wpi/
Disallow /trackback/
Disallow /*/*/*/feed.xml
Disallow /login.php/
Disallow /frontend.php/
Disallow /api/1.0/migration
Disallow /server
Disallow /queue
Disallow /mobile.php/
Disallow /app.php/
Disallow /main.php/
Disallow /redirect
Disallow /approve
Disallow /duplicate
Disallow /1018282
Disallow /api/
Disallow /c/
Disallow /preview-main/*
Disallow /morepostcomments
Disallow /offtopic
Disallow /pda
Disallow /tracker
Disallow /.well-known/amphtml/apikey.pub
Disallow /usuario/*
Disallow /busqueda?
Disallow /search?q=
Disallow /frontend_dev.php/

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.www.dandorra.com/news-sitemap.xml
sitemap https://www.www.dandorra.com/sitemap_index.xml
sitemap https://www.www.dandorra.com/juegos/news-sitemap.xml
sitemap https://www.www.dandorra.com/juegos/sitemap_index.xml
sitemap https://www.www.dandorra.com/gastronomia/news-sitemap.xml
sitemap https://www.www.dandorra.com/gastronomia/sitemap_index.xml

Comments

  • WP
  • Some bots are known to be trouble, particularly those designed to copy
  • entire sites. Please obey robots.txt.
  • Hits many times per second, not acceptable
  • http://www.nameprotect.com/botinfo.html
  • A capture bot, downloads gazillions of pages with no public benefit
  • http://www.webreaper.net/