driversdownload4u.com
robots.txt

Robots Exclusion Standard data for driversdownload4u.com

Resource Scan

Scan Details

Site Domain driversdownload4u.com
Base Domain driversdownload4u.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-14T20:27:48+00:00
Next Scan 2024-12-13T20:27:48+00:00

Last Successful Scan

Scanned2022-07-23T01:00:26+00:00
URL https://driversdownload4u.com/robots.txt
Response IP 87.98.255.17
Found Yes
Hash e66cfa34cb14b7e9c809d391ed6f82b2d649fda4e344952763e56b96a058e8e7
SimHash 6b4fc8c5ed21

Groups

addthis.com

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /files/
Disallow /privacy

spbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.driversdownload4u.com/sitemap1.xml
sitemap https://www.driversdownload4u.com/sitemap2.xml
sitemap https://www.driversdownload4u.com/sitemap3.xml
sitemap https://www.driversdownload4u.com/sitemap4.xml
sitemap https://www.driversdownload4u.com/sitemap5.xml
sitemap https://de.driversdownload4u.com/sitemap1de.xml
sitemap https://de.driversdownload4u.com/sitemap2de.xml
sitemap https://de.driversdownload4u.com/sitemap3de.xml
sitemap https://de.driversdownload4u.com/sitemap4de.xml
sitemap https://fr.driversdownload4u.com/sitemap5de.xml
sitemap https://fr.driversdownload4u.com/sitemap1fr.xml
sitemap https://fr.driversdownload4u.com/sitemap2fr.xml
sitemap https://fr.driversdownload4u.com/sitemap3fr.xml
sitemap https://fr.driversdownload4u.com/sitemap4fr.xml
sitemap https://fr.driversdownload4u.com/sitemap5fr.xml