tips9ja.com
robots.txt

Robots Exclusion Standard data for tips9ja.com

Resource Scan

Scan Details

Site Domain tips9ja.com
Base Domain tips9ja.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-09T02:56:45+00:00
Next Scan 2025-11-10T02:56:45+00:00

Last Successful Scan

Scanned2025-11-01T19:48:50+00:00
URL https://tips9ja.com/robots.txt
Domain IPs 2a02:4780:38:c17:1695:189f:a459:7573, 2a02:4780:39:d14a:624:1aa3:9e95:a1d0, 84.32.84.5, 84.32.84.71
Response IP 77.37.115.245
Found Yes
Hash 4d175c3d45076bfdcac831f04ebc3873a3c76652f2354e05e0505611ec260738
SimHash 5a36cd6a2e3b

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /wp-json/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /cgi-bin/
Disallow /search
Disallow /?s=
Disallow /author/
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow /xmlrpc.php
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Allow /wp-content/themes/*/css/
Allow /wp-content/themes/*/js/
Allow /wp-content/themes/*/images/

semrushbot

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

mj12bot

Rule Path
Allow /

dotbot

Rule Path
Allow /

semrushbot-sa

Rule Path
Disallow /

mj12bot/v1.4.8

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Comments

  • SEO Tools
  • Crawl delay for aggressive bots
  • Sitemaps

Warnings

  • `https` is not a known field.