datasheet4u.net
robots.txt

Robots Exclusion Standard data for datasheet4u.net

Resource Scan

Scan Details

Site Domain datasheet4u.net
Base Domain datasheet4u.net
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-10T14:36:25+00:00
Next Scan 2024-11-08T14:36:25+00:00

Last Successful Scan

Scanned2024-01-14T12:08:55+00:00
URL http://datasheet4u.net/robots.txt
Redirect https://datasheet4u.com/robots.txt
Redirect Domain datasheet4u.com
Redirect Base datasheet4u.com
Domain IPs 49.247.9.204
Redirect IPs 104.26.8.145, 104.26.9.145, 172.67.69.20, 2606:4700:20::681a:891, 2606:4700:20::681a:991, 2606:4700:20::ac43:4514
Response IP 104.26.8.145
Found Yes
Hash c67968346035559a93e30981a367ec1cc358ad843c83f80d48d736ce225339af
SimHash 494dd5336fb1

Groups

*

Rule Path
Allow /
Disallow /datasheet-pdf-file/
Disallow /datasheet-parts/
Disallow /*.pdf$

mj12bot

Rule Path
Disallow /

python-requests/2.28.1

Rule Path
Disallow /

linguee

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

Other Records

Field Value
sitemap https://datasheet4u.com/sitemap/t/500_sitemap.xml