ddpcshares.com
robots.txt

Robots Exclusion Standard data for ddpcshares.com

Resource Scan

Scan Details

Site Domain ddpcshares.com
Base Domain ddpcshares.com
Scan Status Ok
Last Scan2024-06-22T09:17:09+00:00
Next Scan 2024-06-29T09:17:09+00:00

Last Scan

Scanned2024-06-22T09:17:09+00:00
URL https://ddpcshares.com/robots.txt
Redirect https://www.ddpcshares.com/robots.txt
Redirect Domain www.ddpcshares.com
Redirect Base ddpcshares.com
Domain IPs 104.21.46.156, 172.67.140.107, 2606:4700:3030::6815:2e9c, 2606:4700:3030::ac43:8c6b
Redirect IPs 104.21.46.156, 172.67.140.107, 2606:4700:3030::6815:2e9c, 2606:4700:3030::ac43:8c6b
Response IP 172.67.140.107
Found Yes
Hash acf8146860e2dd9679fe0fc41257f5631a24d51b87c9c91d0cde232e9bcedbce
SimHash 481150b1c7e1

Groups

semrushbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Allow *

feedfetcher-google

Rule Path
Allow *

bingbot

Rule Path
Allow *

slurp

Rule Path
Allow *

facebot

Rule Path
Allow *

facebookexternalhit

Rule Path
Allow *

ia_archiver

Rule Path
Allow *

twitterbot

Rule Path
Allow *

*

Rule Path
Disallow /trash