immiboards.com
robots.txt

Robots Exclusion Standard data for immiboards.com

Resource Scan

Scan Details

Site Domain immiboards.com
Base Domain immiboards.com
Scan Status Ok
Last Scan2026-01-19T15:33:54+00:00
Next Scan 2026-01-26T15:33:54+00:00

Last Scan

Scanned2026-01-19T15:33:54+00:00
URL https://immiboards.com/robots.txt
Redirect https://www.immiboards.com/robots.txt
Redirect Domain www.immiboards.com
Redirect Base immiboards.com
Domain IPs 104.26.2.139, 104.26.3.139, 172.67.71.37, 2606:4700:20::681a:28b, 2606:4700:20::681a:38b, 2606:4700:20::ac43:4725
Redirect IPs 104.26.2.139, 104.26.3.139, 172.67.71.37, 2606:4700:20::681a:28b, 2606:4700:20::681a:38b, 2606:4700:20::ac43:4725
Response IP 172.67.71.37
Found Yes
Hash 2ce9e3ecdb013ee3fbe8201b83ff931b4e3486f398a773e4de0e7af5fb94fc93
SimHash 50975d49e8b2

Groups

amazonbot
aspiegelbot
applebot
anthropic-ai
bytespider
claudebot
claude-web
ccbot
dotbot
diffbot
pinterestbot
petalbot
perplexitybot
mauibot
mj12bot
omgili
gort
piplbot
gptbot
chatgpt-user
google-extended
semrush
semrushbot
youbot
voltron

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/uploads/wpforms
Disallow /*.json
Disallow /*.json-compact
Disallow /*.json-html
Disallow /*.rss
Disallow /search/
Disallow /*/search?q=
Disallow /*/search/?q=
Disallow /tags/
Disallow /canada-immigration-forum/*.json
Disallow /canada-immigration-forum/*.json-compact
Disallow /canada-immigration-forum/*.json-html
Disallow /canada-immigration-forum/whats-new/
Disallow /canada-immigration-forum/account/
Disallow /canada-immigration-forum/members/
Disallow /canada-immigration-forum/attachments/
Disallow /canada-immigration-forum/goto/
Disallow /canada-immigration-forum/help/
Disallow /canada-immigration-forum/posts/
Disallow /canada-immigration-forum/login/
Disallow /canada-immigration-forum/search/
Disallow /canada-immigration-forum/admin.php
Disallow /canada-immigration-forum/search/
Disallow /canada-immigration-forum/conversations/
Disallow /canada-immigration-forum/threads/*/reply
Allow /
Allow /*.xml
Allow /canada-immigration-forum/
Allow /canada-immigration-forum/*.xml

Other Records

Field Value
sitemap https://www.immiboards.com/sitemap_index.xml
sitemap https://www.immiboards.com/news-sitemap.xml
sitemap https://www.immiboards.com/category-sitemap.xml
sitemap https://www.immiboards.com/post-sitemap.xml
sitemap https://www.immiboards.com/canada-immigration-forum/sitemap.xml

Comments

  • Our robots.txt is for search engines

Warnings

  • 1 invalid line.