complexprogrammer.uz
robots.txt

Robots Exclusion Standard data for complexprogrammer.uz

Resource Scan

Scan Details

Site Domain complexprogrammer.uz
Base Domain complexprogrammer.uz
Scan Status Ok
Last Scan2024-11-04T13:18:19+00:00
Next Scan 2024-11-11T13:18:19+00:00

Last Scan

Scanned2024-11-04T13:18:19+00:00
URL https://complexprogrammer.uz/robots.txt
Redirect https://complexprogrammer.uz/robots.txt/
Domain IPs 167.235.222.200
Response IP 167.235.222.200
Found Yes
Hash 83e2562c41cc3dfaa1e481300dabc2acf355fa12cc72514537104aafd2e05d88
SimHash 2015d4935595

Groups

googlebot

Rule Path
Disallow /admin/

googlebot-image

Rule Path
Disallow /secret-page/

googlebot-mobile

Rule Path
Disallow /tmp/

msnbot

Rule Path
Disallow /private/

slurp

Rule Path
Disallow /downloads/

teoma

Rule Path
Disallow /downloads/

gigabot

Rule Path
Disallow /downloads/

robozilla

Rule Path
Disallow /downloads/

nutch

Rule Path
Disallow /downloads/

ia_archiver

Rule Path
Disallow /downloads/

baiduspider

Rule Path
Disallow /downloads/

naverbot

Rule Path
Disallow /downloads/

yeti

Rule Path
Disallow /downloads/

yahoo-mmcrawler

Rule Path
Disallow /downloads/

psbot

Rule Path
Disallow /downloads/

yahoo-blogs/v3.9

Rule Path
Disallow /downloads/

*

Rule Path
Disallow /downloads/

*

Rule Path
Disallow /downloads/

magicsearchbot

Rule Path
Disallow /uploads/

Other Records

Field Value
sitemap https://complexprogrammer.uz/sitemap.xml

Comments

  • robots.txt generated by atozseotools.com