us.expertini.com
robots.txt

Robots Exclusion Standard data for us.expertini.com

Resource Scan

Scan Details

Site Domain us.expertini.com
Base Domain expertini.com
Scan Status Ok
Last Scan2025-11-12T16:16:32+00:00
Next Scan 2025-12-12T16:16:32+00:00

Last Scan

Scanned2025-11-12T16:16:32+00:00
URL https://us.expertini.com/robots.txt
Domain IPs 104.26.6.86, 104.26.7.86, 172.67.74.7, 2606:4700:20::681a:656, 2606:4700:20::681a:756, 2606:4700:20::ac43:4a07
Response IP 172.67.74.7
Found Yes
Hash 4c87ba0155e99556f47f38056c55f5a8a0261d599694afc8b4cb96fd9a3490fa
SimHash 28625e46f441

Groups

*

Rule Path
Disallow /validate_input/
Disallow /jobs/salaries/calculate-benchmark/
Disallow /api/
Disallow /google_login/
Disallow /one-tap-login/
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://us.expertini.com/pages.xml
sitemap https://us.expertini.com/sitemapindex.xml
sitemap https://us.expertini.com/searchsitemap.xml
sitemap https://us.expertini.com/regional.xml
sitemap https://us.expertini.com/regionaljobs.xml
sitemap https://us.expertini.com/jobroles.xml
sitemap https://us.expertini.com/jobdescriptions.xml
sitemap https://us.expertini.com/interviewpractice.xml
sitemap https://us.expertini.com/salaries.xml
sitemap https://us.expertini.com/incometax.xml