did2memo.net
robots.txt

Robots Exclusion Standard data for did2memo.net

Resource Scan

Scan Details

Site Domain did2memo.net
Base Domain did2memo.net
Scan Status Ok
Last Scan2024-09-21T16:59:49+00:00
Next Scan 2024-09-28T16:59:49+00:00

Last Scan

Scanned2024-09-21T16:59:49+00:00
URL https://did2memo.net/robots.txt
Domain IPs 104.26.0.93, 104.26.1.93, 172.67.71.193, 2606:4700:20::681a:15d, 2606:4700:20::681a:5d, 2606:4700:20::ac43:47c1
Response IP 104.26.1.93
Found Yes
Hash c2e51e82584b4a26fee4da93e194040aab8c52f65a77338541108e0a765f776a
SimHash 630cc1127331

Groups

*

Rule Path
Disallow /index.php
Disallow /*?
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/
Disallow /tag/
Disallow /archives/
Disallow /page/
Disallow /trackback/
Disallow /*/trackback/
Disallow /*/feed/
Disallow /*.php$
Disallow /*.inc$
Allow /wp-includes/js/
Allow /wp-content/themes/
Allow /wp-content/plugins/
Allow /wp-content/uploads/
Allow /wp-content/uploads-*

googlebot-image

Rule Path
Disallow /wp-includes/
Allow /wp-content/uploads/
Allow /wp-content/uploads-*

mediapartners-google*

Rule Path
Disallow
Allow /*

megalodon

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

baiduspider+

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://did2memo.net/sitemap.xml.gz