mailboxdrive.com
robots.txt

Robots Exclusion Standard data for mailboxdrive.com

Resource Scan

Scan Details

Site Domain mailboxdrive.com
Base Domain mailboxdrive.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-13T14:07:11+00:00
Next Scan 2024-12-12T14:07:11+00:00

Last Successful Scan

Scanned2024-01-25T00:25:11+00:00
URL https://mailboxdrive.com/robots.txt
Domain IPs 188.166.103.175
Response IP 188.166.103.175
Found Yes
Hash 92e8a126dfc13cf85b2ed3ad699793647b1f0827456018160a105b6042088074
SimHash ae4f58574541

Groups

googlebot

Rule Path
Disallow

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

Other Records

Field Value
sitemap https://mailboxdrive.com/sitemap.xml