experian.com
robots.txt

Robots Exclusion Standard data for experian.com

Resource Scan

Scan Details

Site Domain experian.com
Base Domain experian.com
Scan Status Ok
Last Scan2024-11-15T11:01:22+00:00
Next Scan 2024-11-22T11:01:22+00:00

Last Scan

Scanned2024-11-15T11:01:22+00:00
URL https://experian.com/robots.txt
Redirect https://www.experian.com/robots.txt
Redirect Domain www.experian.com
Redirect Base experian.com
Domain IPs 45.60.122.189, 45.60.132.189
Redirect IPs 45.60.126.189
Response IP 45.60.126.189
Found Yes
Hash 23ca99bd6fd4e25344a8760b4b054b346fe0a6e55fa42a615c45abce944debf0
SimHash 886df7da5770

Groups

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /cs.html
Disallow /assets/automotive/white-papers/autocheck-2x-dealer-faq.pdf
Disallow /assets/access/documentation/*
Disallow /assets/integrated-marketing/Offer-Summaries/t-append-lo.pdf
Disallow /assets/business-strategies/brochures/datadirectorynov08.pdf
Disallow /assets/business-information/experian-moodys-small-business-credit-index/*
Disallow /assets/p/*
Disallow /assets/consumer-insights/p/*
Disallow /assets/corporate/p/*
Disallow /assets/marketing-services/p/*
Disallow /corporate/p/*
Disallow /decision-analytics/da-whitepaper-archive.html
Disallow /decision-analytics/da-information-webinars.html
Disallow /assets/decision-analytics/brochures/flexion-platform-brochure-na.pdf
Disallow /sites/experian/strategy-management/assets/flexion-customer-management.pdf
Disallow /sites/experian/strategy-management/assets/flexion-strategy-management.pdf
Disallow /test/*
Disallow /assets/internal/*
Disallow /blogs/hitwise-uk/img_alt
Disallow /blogs/*/tag/*/index.php/page/*
Disallow /blogs/*/tag/search/page/*/?paged*
Disallow /blogs/business-credit/page/*/?author=*
Disallow /marketing-services/p/*
Disallow /*media1$
Disallow /*media2$
Disallow /*media3$
Disallow /*media4$
Disallow /*media5$
Disallow /*media6$
Disallow /marketing-services/p/*
Disallow /poc/*
Disallow /forms/submit.form
Disallow /script/ScriptServlet
Disallow /NetConnect
Disallow /ARFResponse
Disallow /WebDelivery
Disallow /iw-cc/command/
Disallow /consumer/cac/*
Disallow /ncaconline/*
Disallow /cgi-bin/*
Disallow /blogs/*/wp-admin/*
Disallow /blogs/*/plugins/*
Disallow /blogs/*/wp-login*
Disallow /site-includes/*
Disallow /blogs/*/comments/feed/$
Disallow /cms/*
Disallow /assets/business-information/white-papers/*
Disallow /products/pdf/*
Disallow /small-business/mailing-lists/*-mailing-lists.jsp
Disallow /single-crm/*
Disallow /marketing-services/2014-client-summit.html
Disallow /*j%3D*
Disallow /*l%3D*
Disallow /*e%3D*
Disallow /*jb%3D*
Disallow /*mid%3D*
Disallow /*u%3D*
Disallow /js/mbox.js
Allow /blogs/ask-experian/api/get_posts/*

ahrefssiteaudit

Rule Path
Allow /

Warnings

  • 1 invalid line.