Log In Sign Up

pikrepo.com
robots.txt

Robots Exclusion Standard data for pikrepo.com

Resource Scan

Scan Details

Site Domain pikrepo.com
Base Domain pikrepo.com
Scan Status Ok
Last Scan2024-10-01T03:28:01+00:00
Next Scan 2024-10-08T03:28:01+00:00

Last Scan

Scanned2024-10-01T03:28:01+00:00
URL https://pikrepo.com/robots.txt
Redirect https://www.pikrepo.com/robots.txt
Redirect Domain www.pikrepo.com
Redirect Base pikrepo.com
Domain IPs 104.21.43.238, 172.67.189.4, 2606:4700:3035::ac43:bd04, 2606:4700:3037::6815:2bee
Redirect IPs 104.21.43.238, 172.67.189.4, 2606:4700:3035::ac43:bd04, 2606:4700:3037::6815:2bee
Response IP 104.21.43.238
Found Yes
Hash 22d6c444b6e38868a4a39331d4846dba2e1fe0c830bd6f3a804238e67495fcc1
SimHash 8045c7f86d1a

Groups

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

hyscore

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

musobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

qwantify/bleriot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

hubspot crawler

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

*

Rule Path
Allow /
Back to top