kdlocountry.com
robots.txt

Robots Exclusion Standard data for kdlocountry.com

Resource Scan

Scan Details

Site Domain kdlocountry.com
Base Domain kdlocountry.com
Scan Status Ok
Last Scan2024-07-01T13:49:41+00:00
Next Scan 2024-07-08T13:49:41+00:00

Last Scan

Scanned2024-07-01T13:49:41+00:00
URL https://kdlocountry.com/robots.txt
Redirect https://www.kdlocountry.com/?robots=1
Redirect Domain www.kdlocountry.com
Redirect Base kdlocountry.com
Domain IPs 104.21.75.212, 172.67.182.57, 2606:4700:3030::6815:4bd4, 2606:4700:3037::ac43:b639
Redirect IPs 104.21.75.212, 172.67.182.57, 2606:4700:3030::6815:4bd4, 2606:4700:3037::ac43:b639
Response IP 104.21.75.212
Found Yes
Hash ccbc62ebcdcfaa9e05c500ca8af3db60b7617d5f58a1f7e35243a5b0cfa8a522
SimHash 6b011c90a795

Groups

twitterbot

Rule Path
Disallow /calendar/action*
Disallow /events/action*
Disallow /wp-admin
Disallow /wp-login.php
Allow /wp-admin/admin-ajax.php
Allow /wp-content/themes/blacklab/assets/*?
Allow /syndicated-article/*?

Other Records

Field Value
crawl-delay 30

facebookexternalhit

Rule Path
Allow *

*

Rule Path
Disallow /calendar/action*
Disallow /events/action*
Disallow /wp-admin
Disallow /syndicated-article/*?
Disallow /wp-login.php
Allow /wp-admin/admin-ajax.php
Allow /wp-content/themes/blacklab/assets/*?

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.kdlocountry.com/sitemap.xml