blackfridaymatch.com
robots.txt

Robots Exclusion Standard data for blackfridaymatch.com

Resource Scan

Scan Details

Site Domain blackfridaymatch.com
Base Domain blackfridaymatch.com
Scan Status Ok
Last Scan2024-09-24T19:36:29+00:00
Next Scan 2024-10-01T19:36:29+00:00

Last Scan

Scanned2024-09-24T19:36:29+00:00
URL https://blackfridaymatch.com/robots.txt
Redirect https://www.blackfridaymatch.com/robots.txt
Redirect Domain www.blackfridaymatch.com
Redirect Base blackfridaymatch.com
Domain IPs 162.0.229.111
Redirect IPs 162.0.229.111
Response IP 162.0.229.111
Found Yes
Hash e4d459a4bb4a861ebf938f6e18dd4b7eba1f87252fb7b983d1dead193cf11220
SimHash 00bc5141ef06

Groups

googlebot

Rule Path
Allow /
Disallow /adm/
Disallow /login/
Disallow /bbs/board.php?bo_table=proposal
Disallow /proposal
Disallow /shop/

yeti

Rule Path
Allow /
Disallow /adm/
Disallow /login/
Disallow /bbs/board.php?bo_table=proposal
Disallow /proposal
Disallow /shop/

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Product Comment
amazonbot Amazon's user agent
Rule Path
Disallow /

amazon-kendra-web-crawler-*

Product Comment
amazon-kendra-web-crawler-* all customers of Amazon Kendra's web crawler
Rule Path Comment
Disallow / disallow everything

amazon cloudfront

Rule Path
Disallow /

ahrefs

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /