Log In Sign Up

expertia.ai
robots.txt

Robots Exclusion Standard data for expertia.ai

Resource Scan

Scan Details

Site Domain expertia.ai
Base Domain expertia.ai
Scan Status Ok
Last Scan3/17/2025, 9:29:07 AM
Next Scan 3/24/2025, 9:29:07 AM

Last Scan

Scanned3/17/2025, 9:29:07 AM
URL https://expertia.ai/robots.txt
Domain IPs 3.165.102.28, 3.165.102.39, 3.165.102.70, 3.165.102.88
Response IP 3.165.102.39
Found Yes
Hash 207db7790eda19ed2174f96c8259569badbc8778f93d2bc895a55e1e973193a6
SimHash 4b2993bacf1b

Groups

googlebot

Rule Path
Allow /job/

*

Rule Path
Allow /
Allow /job/
Disallow /dashboard/
Disallow /dashboard/**
Disallow /api/
Back to top

Other Records

Field Value
sitemap https://www.expertia.ai/sitemap.xml
sitemap https://www.expertia.ai/sitemap/1
sitemap https://www.expertia.ai/sitemap/2
sitemap https://www.expertia.ai/sitemap/3
sitemap https://www.expertia.ai/sitemap/4
sitemap https://www.expertia.ai/sitemap/5
sitemap https://www.expertia.ai/sitemap/6
sitemap https://www.expertia.ai/sitemap/7
sitemap https://www.expertia.ai/sitemap/8
sitemap https://www.expertia.ai/sitemap/9
sitemap https://www.expertia.ai/sitemap/job/1
sitemap https://www.expertia.ai/sitemap/job/2
sitemap https://www.expertia.ai/sitemap/job/3
sitemap https://www.expertia.ai/sitemap/companies/1
sitemap https://www.expertia.ai/sitemap/companies/2
sitemap https://www.expertia.ai/sitemap/job-postings/1
sitemap https://www.expertia.ai/sitemap/job-postings/2
sitemap https://www.expertia.ai/sitemap/job-postings/3
Back to top