us-buyer.com
robots.txt

Robots Exclusion Standard data for us-buyer.com

Resource Scan

Scan Details

Site Domain us-buyer.com
Base Domain us-buyer.com
Scan Status Ok
Last Scan2024-09-21T02:57:22+00:00
Next Scan 2024-09-28T02:57:22+00:00

Last Scan

Scanned2024-09-21T02:57:22+00:00
URL https://us-buyer.com/robots.txt
Domain IPs 54.183.112.237
Response IP 54.183.112.237
Found Yes
Hash 34c5cef74a070ca7e9c47f3df30b22f4e316ca617f9dea7662c66b7d9b31f813
SimHash 6851d1814345

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

msnbot

Rule Path
Allow /

slurp

Rule Path
Allow /

yahoo-mmcrawler

Rule Path
Allow /

yahoo-blogs/v3.9

Rule Path
Allow /

teoma

Rule Path
Allow /

psbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

amazonbot

Rule Path
Allow /

bingbot

Rule Path
Allow /

y!j-wsc

Rule Path
Allow /

*

Rule Path
Disallow /