lb.catalogs.com
robots.txt
Robots Exclusion Standard data for lb.catalogs.com
Resource Scan
Scan Details
Site Domain | lb.catalogs.com |
Base Domain | catalogs.com |
Scan Status | Ok |
Last Scan | 2024-09-23T00:27:58+00:00 |
Next Scan | 2024-10-23T00:27:58+00:00 |
Last Scan
Scanned | 2024-09-23T00:27:58+00:00 |
URL | https://lb.catalogs.com/robots.txt |
Redirect | https://www.catalogs.com:443/robots.txt |
Redirect Domain | www.catalogs.com |
Redirect Base | catalogs.com |
Domain IPs | 3.213.195.192, 3.224.162.135, 3.225.30.55, 3.230.206.246 |
Response IP | 13.215.144.61 |
Found | Yes |
Hash | e697ee71add0d45ddab8404aa8aa867f1544fdb89ac961710148ff8f3c7ffa56 |
SimHash | 8325334c0e13 |
Groups
*
Rule | Path |
---|---|
Disallow | /affiliate/ |
Disallow | /authorImages/ |
Disallow | /authors/ |
Disallow | /backup/ |
Disallow | /blog_admin/ |
Disallow | /catalog/ |
Disallow | /customerservice/ |
Disallow | /projectgreen/ |
Disallow | /download/ |
Disallow | /dsyn/ |
Disallow | /ftppush/ |
Disallow | /ie7/ |
Disallow | /lauren/ |
Disallow | /mediakit/ |
Disallow | /newsletter/ |
Disallow | /sql/ |
Disallow | /upload/ |
Disallow | /reviews/ |
Disallow | /util/ |
Disallow | /news/ |
Disallow | /catalogue.asp |
Disallow | /order_nocap.asp |
Disallow | /dhl_files/frame.htm |
Disallow | /search_2_dual.asp |
Disallow | /projectgreen.asp |
Disallow | /dhl.htm |
Disallow | /cataloger2.asp |
Disallow | /info/dance.html |
Disallow | /info/dance/ |
Disallow | /info/bestof/wp-content/uploads/ |
Disallow | /newsletter.htm |
Disallow | /linkout.asp |
Disallow | /industry-news/ |
Disallow | /startup/ |
Disallow | /ashley/ |
Disallow | /ashleygetstarted/ |
Disallow | /century21/ |
Disallow | /sothebysrealty/ |
Disallow | /era/ |
Disallow | /cbc/ |
Disallow | /bhgre/ |
Disallow | /cb/ |
Disallow | /blog/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.catalogs.com/sitemap.xml |
Warnings
- `noindex` is not a known field.
Comments