marketers1.com
robots.txt

Robots Exclusion Standard data for marketers1.com

Resource Scan

Scan Details

Site Domain marketers1.com
Base Domain marketers1.com
Scan Status Ok
Last Scan2025-10-01T22:07:14+00:00
Next Scan 2025-10-08T22:07:14+00:00

Last Scan

Scanned2025-10-01T22:07:14+00:00
URL https://marketers1.com/robots.txt
Redirect https://www.marketers1.com/robots.txt
Redirect Domain www.marketers1.com
Redirect Base marketers1.com
Domain IPs 104.21.82.212, 172.67.163.254, 2606:4700:3033::ac43:a3fe, 2606:4700:3034::6815:52d4
Redirect IPs 104.21.82.212, 172.67.163.254, 2606:4700:3033::ac43:a3fe, 2606:4700:3034::6815:52d4
Response IP 104.21.82.212
Found Yes
Hash b5eced39f769480b3272007b18aa56879c10f764757b55044df8e60d5cac92c1
SimHash d8ad05416e21

Groups

*

Rule Path
Disallow /town/
Disallow /towns/
Disallow /country/
Disallow /countries/
Disallow /search/
Disallow /directors/
Disallow /director/
Disallow /actors/
Disallow /actor/
Disallow /genres/
Disallow /genre/
Disallow /producer/
Disallow /screenplaywriter/
Disallow /studio/
Disallow /writer/
Disallow /vicinitysearch
Disallow /*/cities$
Disallow /*/cities/
Disallow /*/showImage%28
Disallow /pv/
Disallow /rf/
Disallow /login/
Disallow /about/
Disallow /contact/
Disallow /cdn-cgi/
Disallow /feature/
Disallow /*?e=
Disallow /*?id=
Disallow /*?c=

semrushbot-sa
semrushbot
blexbot
mj12bot
ahrefsbot
dotbot
megaindex.ru
megaindex.com
mauibot
mauibot (crawler.feedback+wc@gmail.com)
the knowledge ai

Rule Path
Disallow /