bitexpert.io
robots.txt

Robots Exclusion Standard data for bitexpert.io

Resource Scan

Scan Details

Site Domain bitexpert.io
Base Domain bitexpert.io
Scan Status Ok
Last Scan2025-12-08T01:14:50+00:00
Next Scan 2026-01-07T01:14:50+00:00

Last Scan

Scanned2025-12-08T01:14:50+00:00
URL https://bitexpert.io/robots.txt
Domain IPs 104.21.80.10, 172.67.172.145, 2606:4700:3032::ac43:ac91, 2606:4700:3035::6815:500a
Response IP 104.21.80.10
Found Yes
Hash e817fe64c287486a8d1d355822c39d249cea73f528861726f06189ea86a1c0f1
SimHash 4740ce000515

Groups

yandex

Rule Path
Allow /yandex/news/
Disallow /?s=

googlebot

Rule Path
Allow /
Disallow /?s=

msnbot

Rule Path
Allow /
Disallow /?s=

*

Rule Path
Allow /
Disallow /?s=

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

Other Records

Field Value
sitemap https://bitexpert.io/sitemap_index.xml
sitemap https://bitexpert.io/sitemap_index.xml
sitemap https://bitexpert.io/sitemap_index.xml
sitemap https://bitexpert.io/sitemap_index.xml

Comments

  • WP Import Export Rule

Warnings

  • `host` is not a known field.