infozonepk.com
robots.txt

Robots Exclusion Standard data for infozonepk.com

Resource Scan

Scan Details

Site Domain infozonepk.com
Base Domain infozonepk.com
Scan Status Ok
Last Scan2024-10-30T00:09:34+00:00
Next Scan 2024-11-06T00:09:34+00:00

Last Scan

Scanned2024-10-30T00:09:34+00:00
URL https://infozonepk.com/robots.txt
Domain IPs 5.134.8.8
Response IP 5.134.8.8
Found Yes
Hash f9d2bdd50452ed0ffd71544b396ac7c5978e92c2d6a8c3d506cf3981c8e7c6ff
SimHash 639a447088b3

Groups

mj12bot

Rule Path
Disallow /

cyberalert

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

webcrawler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

discobot

Rule Path
Disallow /

birubot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /
Disallow /

gosospider

Rule Path
Disallow /

steeler

Rule Path
Disallow /

summify

Rule Path
Disallow /

accelobot

Rule Path
Disallow /

blp_bbot/0.1

Rule Path
Disallow /

exabot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow error_log
Disallow wp-comments-post.php
Disallow wp-commentsrss2.php
Disallow wp-config.php
Disallow wp-cron.php
Disallow wp-feed.php
Disallow wp-settings.php
Disallow wp-trackback.php
Disallow xmlrpc.php

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.infozonepk.com/sitemap.xml

Warnings

  • 2 invalid lines.
  • `user agent` is not a known field.