discogs.com
robots.txt
Robots Exclusion Standard data for discogs.com
Resource Scan
Scan Details
| Site Domain | discogs.com |
| Base Domain | discogs.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-11T12:32:10+00:00 |
| Next Scan | 2024-11-18T12:32:10+00:00 |
Last Successful Scan
| Scanned | 2023-12-08T02:35:37+00:00 |
| URL | https://discogs.com/robots.txt |
| Redirect | https://www.discogs.com:443/robots.txt |
| Redirect Domain | www.discogs.com |
| Redirect Base | discogs.com |
| Domain IPs | 35.160.27.175, 54.188.132.176, 54.200.136.61 |
| Redirect IPs | 104.18.36.202, 172.64.151.54, 2606:4700:4400::6812:24ca, 2606:4700:4400::ac40:9736 |
| Response IP | 172.64.151.54 |
| Found | Yes |
| Hash | 867172987f875796fb79c1aaf1b36d620a7df0c228afbbe504c1e3cdaf81b105 |
| SimHash | 2d0188404657 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /ads.txt |
| Allow | /*/_graphs/history |
| Allow | /users/forgot_password |
| Disallow | */sell/cart |
| Disallow | */sell/post |
| Disallow | */sell/order/ |
| Disallow | */sell/orders |
| Disallow | */sell/mplistrss |
| Disallow | /submissions |
| Disallow | /*/submissions |
| Disallow | /submission |
| Disallow | */contributions |
| Disallow | /my$ |
| Disallow | /sell/mywants$ |
| Disallow | /browse/my$ |
| Disallow | /recent/my$ |
| Disallow | */messages/ |
| Disallow | /mygroups$ |
| Disallow | /mywantlist$ |
| Disallow | /mycontributions$ |
| Disallow | /mycollection$ |
| Disallow | /marketplace/mywants$ |
| Disallow | */release/add |
| Disallow | /release/edit |
| Disallow | /release/copy |
| Disallow | /update |
| Disallow | /*/update$ |
| Disallow | /login |
| Disallow | /users/ |
| Disallow | /logout |
| Disallow | /redir |
| Disallow | /history |
| Disallow | /*/history |
| Disallow | /*/images$ |
| Disallow | */wantlist$ |
| Disallow | */wantlist?user= |
| Disallow | /rss |
| Disallow | /groups/report |
| Disallow | /artist2 |
| Disallow | /sell/unlist |
| Disallow | /sell/audio |
| Disallow | /service/catalog/api/graphql |
| Disallow | /release/recs |
| Disallow | /projects |
| Disallow | /data$ |
| Disallow | /pt_BR/sell/item |
| Disallow | /pt_BR/sell/list? |
| Disallow | /pt_BR/seller/ |
| Disallow | /ko/sell/item |
| Disallow | /ko/sell/list? |
| Disallow | /ko/seller/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.discogs.com/sitemap_artist.xml |
| sitemap | https://www.discogs.com/sitemap_release.xml |
| sitemap | https://www.discogs.com/sitemap_footer.xml |
| sitemap | https://www.discogs.com/company/sitemap.xml |
| sitemap | https://www.discogs.com/digs/sitemap.xml |
| sitemap | https://www.discogs.com/selling/sitemap.xml |
| sitemap | https://www.discogs.com/record-stores/sitemap.xml |
| sitemap | https://www.discogs.com/media-kit/sitemap.xml |