partsgiant.com
robots.txt

Robots Exclusion Standard data for partsgiant.com

Resource Scan

Scan Details

Site Domain partsgiant.com
Base Domain partsgiant.com
Scan Status Ok
Last Scan2024-08-29T07:22:13+00:00
Next Scan 2024-09-28T07:22:13+00:00

Last Scan

Scanned2024-08-29T07:22:13+00:00
URL https://partsgiant.com/robots.txt
Redirect https://www.partsgiant.com/robots.txt
Redirect Domain www.partsgiant.com
Redirect Base partsgiant.com
Domain IPs 52.0.80.235
Redirect IPs 52.0.80.235
Response IP 52.0.80.235
Found Yes
Hash f626b9c8d0fe92f4e1e6a50c51a0a16ade17f37d62b1bba7e3bb3e7ba2a1776e
SimHash f45c9d42dd31

Groups

*

Rule Path
Disallow /account
Disallow /ajax
Disallow /cart
Disallow /checkout

awariobot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.partsgiant.com/sitemap.xml

Comments

  • Allow robots.
  • Instruct irrelevant marketing bots to bug off.