mx.expertini.com
robots.txt

Robots Exclusion Standard data for mx.expertini.com

Resource Scan

Scan Details

Site Domain mx.expertini.com
Base Domain expertini.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-03T08:36:14+00:00
Next Scan 2025-12-17T08:36:14+00:00

Last Successful Scan

Scanned2025-10-26T05:35:15+00:00
URL https://mx.expertini.com/robots.txt
Domain IPs 104.26.6.86, 104.26.7.86, 172.67.74.7, 2606:4700:20::681a:656, 2606:4700:20::681a:756, 2606:4700:20::ac43:4a07
Response IP 104.26.6.86
Found Yes
Hash 3d4f569959ce00260dc37940d9094cfdb74cbb0af5c838a5057118cbf99c52df
SimHash e7450558c0e1

Groups

*

Rule Path
Disallow /google_login/
Disallow /one-tap-login/
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://mx.expertini.com/jobs/pages.xml
sitemap https://mx.expertini.com/jobs/job_listing1.xml
sitemap https://mx.expertini.com/jobs/search1.xml
sitemap https://mx.expertini.com/jobs/sitemapindex.xml
sitemap https://mx.expertini.com/jobs/searchsitemap.xml
sitemap https://mx.expertini.com/jobs/sitemapindex_amp.xml
sitemap https://mx.expertini.com/jobs/searchsitemap_amp.xml
sitemap https://mx.expertini.com/jobs/searchsitemap_company.xml
sitemap https://mx.expertini.com/jobs/searchsitemap_category.xml
sitemap https://mx.expertini.com/jobs/searchsitemap_locations.xml
sitemap https://mx.expertini.com/jobs/searchsitemap_company_amp.xml
sitemap https://mx.expertini.com/jobs/searchsitemap_category_amp.xml
sitemap https://mx.expertini.com/jobs/searchsitemap_locations_amp.xml
sitemap https://mx.expertini.com/jobs/sitemapindex_pdf.xml
sitemap https://mx.expertini.com/jobs/sitemapindex_png.xml
sitemap https://mx.expertini.com/jobs/searchsitemap_pdf.xml
sitemap https://mx.expertini.com/jobs/searchsitemap_png.xml