Log In Sign Up

pakjobpost.com
robots.txt

Robots Exclusion Standard data for pakjobpost.com

Resource Scan

Scan Details

Site Domain pakjobpost.com
Base Domain pakjobpost.com
Scan Status Ok
Last Scan2025-05-09T09:26:38+00:00
Next Scan 2025-05-16T09:26:38+00:00

Last Scan

Scanned2025-05-09T09:26:38+00:00
URL https://pakjobpost.com/robots.txt
Domain IPs 104.21.33.188, 172.67.148.61, 2606:4700:3036::6815:21bc, 2606:4700:3037::ac43:943d
Response IP 172.67.148.61
Found Yes
Hash 5886d8123284fa8c4c84b81b95fdf9c3e7b5f0a870575a849919197e0014efc9
SimHash 440f4b226591

Groups

*

Rule Path
Disallow
Disallow /admin/
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /user-dashboard/
Disallow /account-settings/
Disallow /checkout/
Disallow /cart/
Disallow /order-history/
Disallow /register/
Disallow /login/
Disallow /cgi-bin/
Disallow /temp/
Disallow /test-page/
Disallow /staging/
Disallow /backup/
Disallow *?sort=
Disallow *?filter=
Disallow *?page=
Disallow *?orderby=
Disallow *?search=
Disallow *?view=
Disallow *?sessionid=
Disallow *?utm_source=
Disallow *?ref=
Disallow *?preview=
Disallow *?tracking=
Disallow *?fbclid=
Disallow *?gclid=
Disallow *?pk_campaign=
Allow /electricity-bill/mepco
Allow /electricity-bill/iesco
Allow /electricity-bill/lesco
Allow /electricity-bill/fesco
Allow /electricity-bill/pesco
Allow /electricity-bill/hesco
Allow /electricity-bill/gepco
Allow /electricity-bill/qesco
Allow /electricity-bill/tesco
Allow /gas-bill/sngpl
Allow /gas-bill/ssgc
Allow /calculate-bill/
Allow /about/
Allow /disclaimer/
Allow /terms-conditions/
Allow /privacy-policy/
Allow /faqs/
Allow /blogs/
Allow /contact
Allow /sitemap_index.xml

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/uploads/private/

googlebot-news

Rule Path
Allow /news/
Allow /blogs/

googlebot-mobile

Rule Path
Allow /

googlebot-discover

Rule Path
Allow /blogs/
Allow /news/

googlebot-video

Rule Path
Allow /videos/

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 3
Back to top

Other Records

Field Value
sitemap https://www.pakbills.info/sitemap_index.xml
Back to top

Comments

  • ======= ALLOW ALL SEARCH ENGINES TO CRAWL ESSENTIAL CONTENT =======
  • ======= BLOCK PRIVATE, SENSITIVE & NON-INDEXABLE PAGES =======
  • ======= BLOCK DUPLICATE, FILTERED & DYNAMIC URL PARAMETERS =======
  • ======= ALLOW GOOGLE & BING TO CRAWL HIGH-VALUE PAGES =======
  • ======= GOOGLEBOT RULES =======
  • ======= BLOCK UNNECESSARY SEO TOOLS & SCRAPERS =======
  • ======= BLOCK BAD BOTS =======
  • ======= ADVANCED CRAWL RATE OPTIMIZATION =======
  • ======= NOINDEX DIRECTIVES (TO PREVENT UNNECESSARY INDEXING) =======
  • ======= INDEX DIRECTIVES (ENSURING IMPORTANT PAGES ARE INDEXED) =======
  • ======= SITEMAP SUBMISSION =======
Back to top

Warnings

  • `index` is not a known field.
  • `noindex` is not a known field.
Back to top