Log In Sign Up

laaldeadelaselva.com
robots.txt

Robots Exclusion Standard data for laaldeadelaselva.com

Resource Scan

Scan Details

Site Domain laaldeadelaselva.com
Base Domain laaldeadelaselva.com
Scan Status Ok
Last Scan2025-12-09T01:14:19+00:00
Next Scan 2026-01-08T01:14:19+00:00

Last Scan

Scanned2025-12-09T01:14:19+00:00
URL https://www.laaldeadelaselva.com/robots.txt
Domain IPs 104.21.32.70, 172.67.184.68, 2606:4700:3031::6815:2046, 2606:4700:3036::ac43:b844
Response IP 104.21.32.70
Found Yes
Hash 53200114a970da3a59380996854625e16a32b038a62df7c81b52a8f789e97cbe
SimHash 445e1b90489b

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow

adsbot-google (+http://www.google.com/adsbot.html)

Rule Path
Disallow

baiduspider

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

bingbot

Rule Path
Disallow

adsbot-google-mobile-apps

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

yahoo-slurp

Rule Path
Disallow

msnbot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

lycos

Rule Path
Disallow

seekbot

Rule Path
Disallow

sistrix

Rule Path
Disallow

searchmetricsbot

Rule Path
Disallow

backlinkcrawler

Rule Path
Disallow

seokicks-robot

Rule Path
Disallow

xovi

Rule Path
Disallow

facebot

Rule Path
Disallow

facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Disallow

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

twitterbot

Rule Path
Disallow

linkedinbot

Rule Path
Disallow

applebot

Rule Path
Disallow

yandexbot

Rule Path
Disallow

yandeximages

Rule Path
Disallow

sogoubot

Rule Path
Disallow

naverbot

Rule Path
Disallow

seznambot

Rule Path
Disallow

exabot

Rule Path
Disallow

bingpreview

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

googlebot-video

Rule Path
Disallow

dotbot

Rule Path
Disallow

whatsapp

Rule Path
Disallow

telegrambot

Rule Path
Disallow

discordbot

Rule Path
Disallow

redditbot

Rule Path
Disallow

mj12bot

Rule Path
Disallow

archivebot

Rule Path
Disallow

wayback

Rule Path
Disallow

pinterestbot

Rule Path
Disallow

skypeuripreview

Rule Path
Disallow

yahoo! slurp china

Rule Path
Disallow

baiduspider-image

Rule Path
Disallow

baiduspider-video

Rule Path
Disallow

gptbot

Rule Path
Disallow

claudebot

Rule Path
Disallow

perplexitybot

Rule Path
Disallow

ccbot

Rule Path
Disallow

google-extended

Rule Path
Disallow

bytespider

Rule Path
Disallow

firecrawlagent

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow

semrushbot

Rule Path
Disallow

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow

adsbot-google (+http://www.google.com/adsbot.html)

Rule Path
Disallow

baiduspider

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

bingbot

Rule Path
Disallow

adsbot-google-mobile-apps

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

yahoo-slurp

Rule Path
Disallow

msnbot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

lycos

Rule Path
Disallow

seekbot

Rule Path
Disallow

sistrix

Rule Path
Disallow

searchmetricsbot

Rule Path
Disallow

backlinkcrawler

Rule Path
Disallow

seokicks-robot

Rule Path
Disallow

xovi

Rule Path
Disallow

facebot

Rule Path
Disallow

facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Disallow

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

twitterbot

Rule Path
Disallow

linkedinbot

Rule Path
Disallow

applebot

Rule Path
Disallow

yandexbot

Rule Path
Disallow

yandeximages

Rule Path
Disallow

sogoubot

Rule Path
Disallow

naverbot

Rule Path
Disallow

seznambot

Rule Path
Disallow

exabot

Rule Path
Disallow

bingpreview

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

googlebot-video

Rule Path
Disallow

dotbot

Rule Path
Disallow

whatsapp

Rule Path
Disallow

telegrambot

Rule Path
Disallow

discordbot

Rule Path
Disallow

redditbot

Rule Path
Disallow

mj12bot

Rule Path
Disallow

archivebot

Rule Path
Disallow

wayback

Rule Path
Disallow

pinterestbot

Rule Path
Disallow

skypeuripreview

Rule Path
Disallow

yahoo! slurp china

Rule Path
Disallow

baiduspider-image

Rule Path
Disallow

baiduspider-video

Rule Path
Disallow

gptbot

Rule Path
Disallow

claudebot

Rule Path
Disallow

perplexitybot

Rule Path
Disallow

ccbot

Rule Path
Disallow

google-extended

Rule Path
Disallow

bytespider

Rule Path
Disallow

firecrawlagent

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow

semrushbot

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap <?= $Json_Pos->URL; ?>sitemap.xml
Back to top

Warnings

  • 10 invalid lines.
  • `header('content-type` is not a known field.
Back to top