diggity.info
robots.txt

Robots Exclusion Standard data for diggity.info

Resource Scan

Scan Details

Site Domain diggity.info
Base Domain diggity.info
Scan Status Ok
Last Scan2025-11-04T22:41:52+00:00
Next Scan 2025-11-11T22:41:52+00:00

Last Scan

Scanned2025-11-04T22:41:52+00:00
URL https://diggity.info/robots.txt
Domain IPs 104.21.12.119, 172.67.132.35, 2606:4700:3030::6815:c77, 2606:4700:3035::ac43:8423
Response IP 104.21.12.119
Found Yes
Hash 78d56772118c7ab3214a3413b849d4c871498ff4bd2f4a973aa9578f9b2976a6
SimHash 0418cae08513

Groups

*

Rule Path
Disallow /*curr%3D

baiduspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /