pacificcustoms.com
robots.txt

Robots Exclusion Standard data for pacificcustoms.com

Resource Scan

Scan Details

Site Domain pacificcustoms.com
Base Domain pacificcustoms.com
Scan Status Ok
Last Scan2024-09-12T22:02:20+00:00
Next Scan 2024-10-12T22:02:20+00:00

Last Scan

Scanned2024-09-12T22:02:20+00:00
URL https://pacificcustoms.com/robots.txt
Redirect https://www.pacificcustoms.com/robots.txt
Redirect Domain www.pacificcustoms.com
Redirect Base pacificcustoms.com
Domain IPs 45.32.84.74
Redirect IPs 45.32.84.74
Response IP 45.32.84.74
Found Yes
Hash 5f4b6a354aa50b540f6a6d97e7077d037ebbeeb9e15a014d52142ae915735f2e
SimHash 211ccc5164ab

Groups

mj12bot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 600

curl/7.15+ (x64-criteo) libcurl/7.15+ openssl zlib libidn

Rule Path
Disallow *

compspybot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

msnbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 600

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

dotbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

amazonbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 600

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 600

Other Records

Field Value
sitemap https://www.pacificcustoms.com/MoogleSitemap00.xml