tdhost.com.br
robots.txt

Robots Exclusion Standard data for tdhost.com.br

Resource Scan

Scan Details

Site Domain tdhost.com.br
Base Domain tdhost.com.br
Scan Status Ok
Last Scan6/1/2025, 6:27:47 AM
Next Scan 6/8/2025, 6:27:47 AM

Last Scan

Scanned6/1/2025, 6:27:47 AM
URL https://tdhost.com.br/robots.txt
Domain IPs 104.21.51.136, 172.67.181.37, 2606:4700:3030::ac43:b525, 2606:4700:3032::6815:3388
Response IP 172.67.181.37
Found Yes
Hash f082de330126e9171aa75430d628fed2ee9d173f29f39209835d37580fde3222
SimHash 6d0cc8f4cf31

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap http://tdhost.com.br/sitemap_index_1.xml
sitemap http://tdhost.com.br/sitemap_index_2.xml
sitemap http://tdhost.com.br/sitemap_index_3.xml
sitemap http://tdhost.com.br/sitemap_index_4.xml
sitemap http://tdhost.com.br/sitemap_index_5.xml
sitemap http://tdhost.com.br/sitemap_index_6.xml
sitemap http://tdhost.com.br/sitemap_index_7.xml
sitemap http://tdhost.com.br/sitemap_index_8.xml