apex.com.lk
robots.txt

Robots Exclusion Standard data for apex.com.lk

Resource Scan

Scan Details

Site Domain apex.com.lk
Base Domain apex.com.lk
Scan Status Ok
Last Scan2025-06-25T14:28:51+00:00
Next Scan 2025-07-25T14:28:51+00:00

Last Scan

Scanned2025-06-25T14:28:51+00:00
URL https://apex.com.lk/robots.txt
Domain IPs 104.21.61.76, 172.67.207.97, 2606:4700:3032::6815:3d4c, 2606:4700:3035::ac43:cf61
Response IP 172.67.207.97
Found Yes
Hash 6c45407dbe26092d72d85587142a6235feea550f7d083cb67e7d3f94d793c176
SimHash 2850d2924793

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

robozilla

Rule Path
Disallow

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow /

*

Rule Path
Disallow /
Disallow /cgi-bin/
Disallow /card/

Other Records

Field Value
sitemap https://apex.com.lk/sitemap.xl