static.buydomains.com
robots.txt
Robots Exclusion Standard data for static.buydomains.com
Resource Scan
Scan Details
Site Domain | static.buydomains.com |
Base Domain | buydomains.com |
Scan Status | Ok |
Last Scan | 2024-04-20T00:06:46+00:00 |
Next Scan | 2024-05-20T00:06:46+00:00 |
Last Scan
Scanned | 2024-04-20T00:06:46+00:00 |
URL | https://static.buydomains.com/robots.txt |
Domain IPs | 52.84.162.105, 52.84.162.71, 52.84.162.91, 52.84.162.96 |
Response IP | 18.165.171.92 |
Found | Yes |
Hash | ffa17500f251dd1ddea3b9227175133f258be889651a636bbd9c5a689e655e66 |
SimHash | d4b37f3a8c93 |
Groups
*
Rule | Path |
---|---|
Disallow | /lander/* |
Disallow | /servlet/UserPrice |
Disallow | /servlet/PrivateSale |
Disallow | /servlet/Affiliate |
Disallow | /servlet/shoppingCart |
Disallow | /register-a-domain/index.jsp |
Disallow | /addcart/ |
Disallow | /buy/ |
Disallow | /Cart/ |
Disallow | /cart/ |
Disallow | /_view/shoppingCart/ |
Disallow | /*utm_source |
Disallow | /*referrer_id |
Disallow | /*home.jsp |
Disallow | /*cm_mmc |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |