Log In Sign Up

hoster.pk
robots.txt

Robots Exclusion Standard data for hoster.pk

Resource Scan

Scan Details

Site Domain hoster.pk
Base Domain hoster.pk
Scan Status Ok
Last Scan2025-09-24T23:48:36+00:00
Next Scan 2025-10-24T23:48:36+00:00

Last Scan

Scanned2025-09-24T23:48:36+00:00
URL https://hoster.pk/robots.txt
Domain IPs 104.21.0.162, 172.67.151.80, 2606:4700:3031::ac43:9750, 2606:4700:3033::6815:a2
Response IP 104.21.0.162
Found Yes
Hash bc281518644f2acd8585f34f96cd749155064f156bfda39d407299d76e58afa0
SimHash 5baa50442493

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Allow /wp-admin/admin-ajax.php
Disallow /?s=
Disallow /search/
Disallow /author/
Disallow /tag/
Disallow /?replytocom=
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /wp-content/plugins/
Back to top

Other Records

Field Value
sitemap https://www.hosterpk.com/sitemap
Back to top

Comments

  • robots.txt for https://hoster.pk/
  • Block duplicate or low-value pages
  • Ensure media, themes, plugins are crawlable
  • Sitemap reference
Back to top