mucindaitin.com
robots.txt

Robots Exclusion Standard data for mucindaitin.com

Resource Scan

Scan Details

Site Domain mucindaitin.com
Base Domain mucindaitin.com
Scan Status Ok
Last Scan2025-09-24T00:30:56+00:00
Next Scan 2025-10-01T00:30:56+00:00

Last Scan

Scanned2025-09-24T00:30:56+00:00
URL https://mucindaitin.com/robots.txt
Domain IPs 45.252.251.35
Response IP 45.252.251.35
Found Yes
Hash fa2aaa742b05d363ce0c775f8aa12aecbceb459b7a668cde6ec8b915448b96e0
SimHash 6a5ec9106af8

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /apple-app-site-association
Disallow /*.woff2$
Disallow /.well-known/apple-app-site-association
Disallow /search/
Disallow /author/
Disallow */author/
Disallow /*?amp=1
Disallow */amp/
Disallow */page/
Disallow /page/
Disallow */tag/
Disallow /*?nonamp=1*
Disallow /*?s=*
Disallow /*utm_source%3D
Disallow /*utm_medium%3D
Disallow /*utm_campaign%3D
Disallow /*.php$
Disallow /*.pdf$
Disallow /*.doc$
Disallow /*.xls$
Disallow /*/feed/
Disallow /feed/
Disallow /category/feed/
Disallow /tag/feed/
Disallow /wp-json/
Disallow /?rest_route=*
Disallow /firebase-messaging-sw
Disallow /*?customize_changeset_uuid=*
Disallow /?customize_changeset_uuid=

teleport

Rule Path
Disallow /

httrack

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

webzip

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sistrixbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

downthemall

Rule Path
Disallow /

wget

Rule Path
Disallow /

curl

Rule Path
Disallow /

fget

Rule Path
Disallow /

httpclient

Rule Path
Disallow /

badbot

Rule Path
Disallow /

spambot

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

pagepeeker

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://mucindaitin.com/sitemap_index.xml

Comments

  • sitemap