donanimgunlugu.com
robots.txt

Robots Exclusion Standard data for donanimgunlugu.com

Resource Scan

Scan Details

Site Domain donanimgunlugu.com
Base Domain donanimgunlugu.com
Scan Status Ok
Last Scan2024-11-17T17:19:20+00:00
Next Scan 2024-11-24T17:19:20+00:00

Last Scan

Scanned2024-11-17T17:19:20+00:00
URL https://donanimgunlugu.com/robots.txt
Domain IPs 104.21.87.174, 172.67.170.122, 2606:4700:3032::6815:57ae, 2606:4700:3032::ac43:aa7a
Response IP 172.67.170.122
Found Yes
Hash fa0e527f771e8f7638840684968d931b3711e1203a9bb16cb6215d0daa051e94
SimHash 4b4efcd79ad2

Groups

*

Rule Path
Disallow */?s=*
Disallow */?noamp=*
Disallow /*?relatedposts
Disallow /*_ppp%3D*
Disallow */embed/
Disallow */feed/

ia_archiver

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

freefind

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

yandex

Rule Path
Disallow

Other Records

Field Value
sitemap https://donanimgunlugu.com/sitemap_index.xml
sitemap https://donanimgunlugu.com/news-sitemap.xml

Warnings

  • `clean-param` is not a known field.