dogrulukpayi.com
robots.txt

Robots Exclusion Standard data for dogrulukpayi.com

Resource Scan

Scan Details

Site Domain dogrulukpayi.com
Base Domain dogrulukpayi.com
Scan Status Ok
Last Scan2025-04-26T10:26:15+00:00
Next Scan 2025-05-26T10:26:15+00:00

Last Scan

Scanned2025-04-26T10:26:15+00:00
URL https://dogrulukpayi.com/robots.txt
Redirect https://www.dogrulukpayi.com/robots.txt
Redirect Domain www.dogrulukpayi.com
Redirect Base dogrulukpayi.com
Domain IPs 104.21.32.186, 172.67.153.176, 2606:4700:3031::ac43:99b0, 2606:4700:3033::6815:20ba
Redirect IPs 104.21.32.186, 172.67.153.176, 2606:4700:3031::ac43:99b0, 2606:4700:3033::6815:20ba
Response IP 104.21.32.186
Found Yes
Hash e5739072f1a1d2f4322c885ca05450e8560bc601c9dbb1cffbd49f7f95e96d44
SimHash 381c420387d1

Groups

*

Rule Path
Allow /
Disallow /manager

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow

twitterbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.dogrulukpayi.com/sitemap.xml

Comments

  • Allow: /sitemap.xml