Log In Sign Up

web-profile.net
robots.txt

Robots Exclusion Standard data for web-profile.net

Resource Scan

Scan Details

Site Domain web-profile.net
Base Domain web-profile.net
Scan Status Ok
Last Scan2025-09-04T03:30:57+00:00
Next Scan 2025-09-11T03:30:57+00:00

Last Scan

Scanned2025-09-04T03:30:57+00:00
URL https://web-profile.net/robots.txt
Domain IPs 66.29.141.5
Response IP 66.29.141.5
Found Yes
Hash f6a8c1b232be761a7b66e93f1dabc92751519ad987e118c1b0532fd7f20e59b9
SimHash ca3c4c00a8a2

Groups

*

Rule Path
Disallow /wp-admin/

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://web-profile.net/sitemap.xml
Back to top

Comments

  • BEGIN Silver Bullet Pro
  • Block MegaIndex.ru
  • Block majestic12 majestic12.co.uk/bot.php
  • Block AhrefsBot https://ahrefs.com/robot
  • Block DotBot https://moz.com/researchtools/ose/dotbot
  • END Silver Bullet Pro
Back to top