bps.lk
robots.txt

Robots Exclusion Standard data for bps.lk

Resource Scan

Scan Details

Site Domain bps.lk
Base Domain bps.lk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-23T03:36:18+00:00
Next Scan 2026-01-22T03:36:18+00:00

Last Successful Scan

Scanned2025-09-01T13:45:55+00:00
URL https://bps.lk/robots.txt
Domain IPs 64.235.61.95
Response IP 64.235.61.95
Found Yes
Hash 50f46c55cef79430fb322b2c6406037a61441b62d0e995dfd9a757e8f9759ba9
SimHash 615d184b95c1

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

archive.org_bot

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

nutch

Rule Path
Disallow /

psbot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

yahoo-blogs/v3.9

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

picsearch.com

Rule Path
Disallow /

picsearch

Rule Path
Disallow /

softlayer.com

Rule Path
Disallow /

*

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /testing/
Disallow /txp/

Comments

  • robots.txt generated at http://www.mcanerin.com
  • Sitemap: http://www.yoursite.com/sitemap.gz