img.joemonster.org
robots.txt

Robots Exclusion Standard data for img.joemonster.org

Resource Scan

Scan Details

Site Domain img.joemonster.org
Base Domain joemonster.org
Scan Status Ok
Last Scan2024-04-27T07:45:11+00:00
Next Scan 2024-05-04T07:45:11+00:00

Last Scan

Scanned2024-04-27T07:45:11+00:00
URL https://img.joemonster.org/robots.txt
Redirect https://joemonster.org/robots.txt
Redirect Domain joemonster.org
Redirect Base joemonster.org
Domain IPs 137.74.32.121, 157.90.168.251, 162.55.172.15, 188.165.22.129, 195.154.113.62, 195.154.161.88, 65.21.63.228
Redirect IPs 104.26.14.144, 104.26.15.144, 172.67.70.10
Response IP 104.26.14.144
Found Yes
Hash 785b764a494c9c1f9e708ac2e89a4955f6ca6c7b6a1daa9174707a3ce84c7fce
SimHash 6b55c4a30725

Groups

*

Rule Path
Disallow /admin.php
Disallow /admin/
Disallow /includes/
Disallow /themes/
Disallow /blocks/
Disallow /modules/
Disallow /language/
Disallow /comments.php
Disallow /top.php
Disallow /search.php

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Disallow /admin.php
Disallow /admin/
Disallow /includes/
Disallow /themes/
Disallow /blocks/
Disallow /modules/
Disallow /language/
Disallow /comments.php
Disallow /top.php

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /admin.php
Disallow /admin/
Disallow /includes/
Disallow /themes/
Disallow /blocks/
Disallow /modules/
Disallow /language/
Disallow /comments.php
Disallow /top.php

Other Records

Field Value
crawl-delay 10

tineye
yahooseeker/m1a1-r2d2
msnbot_mobile

Rule Path
Allow /amp/
Disallow /

mj12bot
seokicks
semrushbot
yandex
blexbot
barkrowler
seekportbot

Rule Path
Disallow /

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • User-agent: Googlebot-Mobile #TESTOWE zdjęcie blokady