movieposterdb.com
robots.txt

Robots Exclusion Standard data for movieposterdb.com

Resource Scan

Scan Details

Site Domain movieposterdb.com
Base Domain movieposterdb.com
Scan Status Ok
Last Scan2024-09-22T07:18:23+00:00
Next Scan 2024-10-22T07:18:23+00:00

Last Scan

Scanned2024-09-22T07:18:23+00:00
URL https://movieposterdb.com/robots.txt
Redirect https://www.movieposterdb.com/robots.txt
Redirect Domain www.movieposterdb.com
Redirect Base movieposterdb.com
Domain IPs 167.99.216.174
Redirect IPs 167.99.216.174
Response IP 167.99.216.174
Found Yes
Hash 6b260ece7d1ae7acdd54db5cc45b1793f0c9f5a6f2a44c91f4c41cc25d25a0bb
SimHash d91cc48a4c10

Groups

*

Rule Path
Allow /

seekport crawler

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

lcc

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

daum

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /