madamemadeline.com
robots.txt

Robots Exclusion Standard data for madamemadeline.com

Resource Scan

Scan Details

Site Domain madamemadeline.com
Base Domain madamemadeline.com
Scan Status Ok
Last Scan2025-12-19T22:15:26+00:00
Next Scan 2026-01-18T22:15:26+00:00

Last Scan

Scanned2025-12-19T22:15:26+00:00
URL https://madamemadeline.com/robots.txt
Redirect https://www.madamemadeline.com/robots.txt
Redirect Domain www.madamemadeline.com
Redirect Base madamemadeline.com
Domain IPs 204.44.192.83
Redirect IPs 204.44.192.83
Response IP 204.44.192.83
Found Yes
Hash dcbb262cf5aeb37bc9f71449abd76d66109ef09245dbfd38189c15d25f59b795
SimHash 58cf5fd8ee9b

Groups

*

Rule Path
Disallow

blexbot

Rule Path
Disallow

metajobbot

Rule Path
Disallow

yandexbot

Rule Path
Disallow

magpie-crawler

Rule Path
Disallow

site.ru

Rule Path
Disallow

seznambot

Rule Path
Disallow

mail.ru bot

Rule Path
Disallow

grapeshotcrawler

Rule Path
Disallow

seokicks-robot

Rule Path
Disallow

mj12bot

Rule Path
Disallow

baiduspider-image

Rule Path
Disallow

seoscanners.net

Rule Path
Disallow

dotbot

Rule Path
Disallow

baidu

Rule Path
Disallow

megaindex.ru

Rule Path
Disallow

mauibot

Rule Path
Disallow

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 14400

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 14400

Other Records

Field Value
sitemap https://www.madamemadeline.com/sitemap.xml
sitemap https://www.madamemadeline.com/false-lashes/sitemap_index.xml

Warnings

  • 2 invalid lines.