codeprj.com
robots.txt

Robots Exclusion Standard data for codeprj.com

Resource Scan

Scan Details

Site Domain codeprj.com
Base Domain codeprj.com
Scan Status Ok
Last Scan2024-11-15T05:35:48+00:00
Next Scan 2024-11-22T05:35:48+00:00

Last Scan

Scanned2024-11-15T05:35:48+00:00
URL https://www.codeprj.com/robots.txt
Domain IPs 112.124.33.156
Response IP 112.124.33.156
Found Yes
Hash e4805ba854630f19a7bf77889ac9e3146745878af6f1ff40a9ebaf5bbdd8a7de
SimHash 89bcc2e6cab9

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mappy

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

olecrawler

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

bubing

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

riddler

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

teleport

Rule Path
Disallow /

offline

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

larbin

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

moget

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /link/
Disallow /go/
Disallow /zh/go/
Disallow /so
Disallow /twblog