Log In Sign Up

amadersomaj.com
robots.txt

Robots Exclusion Standard data for amadersomaj.com

Resource Scan

Scan Details

Site Domain amadersomaj.com
Base Domain amadersomaj.com
Scan Status Ok
Last Scan2025-10-29T13:11:50+00:00
Next Scan 2025-11-05T13:11:50+00:00

Last Scan

Scanned2025-10-29T13:11:50+00:00
URL https://amadersomaj.com/robots.txt
Domain IPs 135.181.134.243
Response IP 135.181.134.243
Found Yes
Hash f9eea7deda0fe6a1aeabc48d87f1df4fd6fab22060e667cdfd75467f9a40ebe1
SimHash 2892500385db

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /includes/
Disallow /tmp/
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /backup/
Disallow /logs/
Disallow /config/
Disallow /private/
Disallow /search?q=

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

google-site-verification

Rule Path
Allow /

google-extended

Rule Path
Allow /

bingbot

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

applebot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

sogou

Rule Path
Allow /

seznambot

Rule Path
Allow /

openaibot

Rule Path
Allow /

chatgptbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

youbot

Rule Path
Allow /

wikibot

Rule Path
Allow /

wikipediabot

Rule Path
Allow /

knowledgegraphbot

Rule Path
Allow /

theknowledgegraphbot

Rule Path
Allow /

facebot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

facebookbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

telegrambot

Rule Path
Allow /

whatsapp

Rule Path
Allow /

pinterestbot

Rule Path
Allow /

redditbot

Rule Path
Allow /

discordbot

Rule Path
Allow /

slackbot

Rule Path
Allow /

instagrambot

Rule Path
Allow /

tiktokbot

Rule Path
Allow /

quorabot

Rule Path
Allow /

mediumbot

Rule Path
Allow /

archive.org_bot

Rule Path
Allow /

internet-archive

Rule Path
Allow /

archiveit

Rule Path
Allow /

bytespider

Rule Path
Allow /

asterias

Rule Path
Disallow /

backdoorbot

Rule Path
Disallow /

black hole

Rule Path
Disallow /

blowfish

Rule Path
Disallow /

botalot

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

discobot

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

fetch

Rule Path
Disallow /

httrack

Rule Path
Disallow /

infonavirobot

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

missigua locator

Rule Path
Disallow /

moget

Rule Path
Disallow /

netants

Rule Path
Disallow /

openfind

Rule Path
Disallow /

repomonkey

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

spiderku

Rule Path
Disallow /

steeler

Rule Path
Disallow /

teleport

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wget

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

atomic_email_hunter

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

commoncrawl

Rule Path
Disallow /

dataforseo

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

screamingfrog

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

apache-httpclient

Rule Path
Disallow /

hts

Rule Path
Disallow /

webwhacker

Rule Path
Disallow /

googlebot-image

Rule Path
Allow /uploads/

bingbot-image

Rule Path
Allow /uploads/

yahoo! slurp-image

Rule Path
Allow /uploads/

baiduspider-image

Rule Path
Allow /uploads/

*

Rule Path
Allow /wp-content/themes/
Allow /wp-content/plugins/
Allow /wp-includes/js/
Allow /wp-json/

*

Rule Path
Disallow /*.php$
Disallow /*.sql$
Disallow /*.zip$
Disallow /*.tar$
Disallow /*.gz$
Disallow /*.log$
Disallow /*.bak$
Back to top

Other Records

Field Value
sitemap https://amadersomaj.com/sitemap.xml
Back to top

Comments

  • 🚨 Warning: Disobeying these rules will result in an IP ban! 🚨
  • âœ
  • 🔥 Extra AI Bots & Knowledge Graph Bots Allowed
  • 📱 Social Media Bots - ALLOWED
  • 🗄️ Archive & Wayback Machine - ALLOWED
  • ❌ BAD BOTS - BLOCKED ❌
  • 🛑 Prevent Fake Bots & AI Scrapers
  • 🚀 Smart Image Indexing Control
  • 🌍 Allow CSS, JS, and API Access
  • 📌 Prevent Sensitive File Access
  • 🚀 Sitemap for SEO Boost
Back to top

Warnings

  • 1 invalid line.
Back to top