bdir.com
robots.txt

Robots Exclusion Standard data for bdir.com

Resource Scan

Scan Details

Site Domain bdir.com
Base Domain bdir.com
Scan Status Ok
Last Scan2025-08-22T02:05:09+00:00
Next Scan 2025-09-21T02:05:09+00:00

Last Scan

Scanned2025-08-22T02:05:09+00:00
URL https://bdir.com/robots.txt
Redirect https://www.bdir.com/robots.txt
Redirect Domain www.bdir.com
Redirect Base bdir.com
Domain IPs 104.21.8.116, 172.67.130.111, 2606:4700:3033::ac43:826f, 2606:4700:3035::6815:874
Redirect IPs 104.21.8.116, 172.67.130.111, 2606:4700:3033::ac43:826f, 2606:4700:3035::6815:874
Response IP 172.67.130.111
Found Yes
Hash 49baff5e5c3294bbda62b5617d43e63a06bcd2ec2a45dc03198b5cc888b6678d
SimHash b3402d06fcf1

Groups

*

Rule Path
Disallow /b2b/
Disallow /*_page*
Disallow /fr/*_page*
Disallow /es/*_page*
Disallow /de/*_page*
Disallow /pt/*_page*
Disallow /it/*_page*
Disallow /ru/*_page*
Disallow /ar/*_page*
Disallow /id/*_page*
Disallow /th/*_page*
Disallow /tr/*_page*
Disallow /nl/*_page*

Other Records

Field Value
sitemap https://www.bdir.com/sitemap.xml
sitemap https://www.bdir.com/fr_sitemap.xml
sitemap https://www.bdir.com/es_sitemap.xml
sitemap https://www.bdir.com/de_sitemap.xml
sitemap https://www.bdir.com/pt_sitemap.xml
sitemap https://www.bdir.com/it_sitemap.xml
sitemap https://www.bdir.com/ru_sitemap.xml
sitemap https://www.bdir.com/ar_sitemap.xml
sitemap https://www.bdir.com/id_sitemap.xml
sitemap https://www.bdir.com/th_sitemap.xml
sitemap https://www.bdir.com/tr_sitemap.xml
sitemap https://www.bdir.com/nl_sitemap.xml