catalogs.com
robots.txt
Robots Exclusion Standard data for catalogs.com
Resource Scan
Scan Details
| Site Domain | catalogs.com |
| Base Domain | catalogs.com |
| Scan Status | Ok |
| Last Scan | 2024-09-18T17:49:54+00:00 |
| Next Scan | 2024-09-25T17:49:54+00:00 |
Last Scan
| Scanned | 2024-09-18T17:49:54+00:00 |
| URL | https://catalogs.com/robots.txt |
| Redirect | https://www.catalogs.com:443/robots.txt |
| Redirect Domain | www.catalogs.com |
| Redirect Base | catalogs.com |
| Domain IPs | 23.21.220.112, 3.213.195.192, 3.224.162.135, 3.225.30.55 |
| Redirect IPs | 13.215.144.61, 13.228.199.255, 2406:da18:880:3802::c8, 2406:da18:b3d:e200::64 |
| Response IP | 52.74.166.77 |
| Found | Yes |
| Hash | e697ee71add0d45ddab8404aa8aa867f1544fdb89ac961710148ff8f3c7ffa56 |
| SimHash | 8325334c0e13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /affiliate/ |
| Disallow | /authorImages/ |
| Disallow | /authors/ |
| Disallow | /backup/ |
| Disallow | /blog_admin/ |
| Disallow | /catalog/ |
| Disallow | /customerservice/ |
| Disallow | /projectgreen/ |
| Disallow | /download/ |
| Disallow | /dsyn/ |
| Disallow | /ftppush/ |
| Disallow | /ie7/ |
| Disallow | /lauren/ |
| Disallow | /mediakit/ |
| Disallow | /newsletter/ |
| Disallow | /sql/ |
| Disallow | /upload/ |
| Disallow | /reviews/ |
| Disallow | /util/ |
| Disallow | /news/ |
| Disallow | /catalogue.asp |
| Disallow | /order_nocap.asp |
| Disallow | /dhl_files/frame.htm |
| Disallow | /search_2_dual.asp |
| Disallow | /projectgreen.asp |
| Disallow | /dhl.htm |
| Disallow | /cataloger2.asp |
| Disallow | /info/dance.html |
| Disallow | /info/dance/ |
| Disallow | /info/bestof/wp-content/uploads/ |
| Disallow | /newsletter.htm |
| Disallow | /linkout.asp |
| Disallow | /industry-news/ |
| Disallow | /startup/ |
| Disallow | /ashley/ |
| Disallow | /ashleygetstarted/ |
| Disallow | /century21/ |
| Disallow | /sothebysrealty/ |
| Disallow | /era/ |
| Disallow | /cbc/ |
| Disallow | /bhgre/ |
| Disallow | /cb/ |
| Disallow | /blog/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.catalogs.com/sitemap.xml |
Warnings
- `noindex` is not a known field.
Comments