directlinks.co
robots.txt

Robots Exclusion Standard data for directlinks.co

Resource Scan

Scan Details

Site Domain directlinks.co
Base Domain directlinks.co
Scan Status Ok
Last Scan2024-10-09T23:29:31+00:00
Next Scan 2024-10-16T23:29:31+00:00

Last Scan

Scanned2024-10-09T23:29:31+00:00
URL https://directlinks.co/robots.txt
Domain IPs 104.21.58.29, 172.67.155.75, 2606:4700:3032::6815:3a1d, 2606:4700:3035::ac43:9b4b
Response IP 104.21.58.29
Found Yes
Hash 1280c488c07170023823f6de8969d98e5d833c28632b96e8d1a85f50a98afd85
SimHash d82488708e32

Groups

*

Rule Path
Disallow /wp-admin/
Disallow */trackback/
Disallow *?wptheme=
Disallow *?comments=
Disallow *?replytocom
Disallow *?attachment_id=
Disallow */trackback*
Allow /wp-admin/admin-ajax.php

sogou web spider

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

addthis.com (http://support.addthis.com/)

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

proximic

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://directlinks.co/sitemap_index.xml