netmarketshare.com
robots.txt

Robots Exclusion Standard data for netmarketshare.com

Resource Scan

Scan Details

Site Domain netmarketshare.com
Base Domain netmarketshare.com
Scan Status Ok
Last Scan2024-09-23T13:52:06+00:00
Next Scan 2024-10-23T13:52:06+00:00

Last Scan

Scanned2024-09-23T13:52:06+00:00
URL https://netmarketshare.com/robots.txt
Domain IPs 52.43.56.26, 54.214.105.245
Response IP 52.43.56.26
Found Yes
Hash 4550adde71405f257d479e8cf1c844fe373a23c1ba94ae44d6326ccfe41148b7
SimHash 883b90b3e2ab

Groups

rogerbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

facebookexternalhit

Rule Path
Allow /images

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5