ml.scribd.com
robots.txt
Robots Exclusion Standard data for ml.scribd.com
Resource Scan
Scan Details
| Site Domain | ml.scribd.com |
| Base Domain | scribd.com |
| Scan Status | Ok |
| Last Scan | 2024-05-20T13:19:27+00:00 |
| Next Scan | 2024-06-03T13:19:27+00:00 |
Last Scan
| Scanned | 2024-05-20T13:19:27+00:00 |
| URL | https://ml.scribd.com/robots.txt |
| Redirect | https://www.scribd.com/robots.txt |
| Redirect Domain | www.scribd.com |
| Redirect Base | scribd.com |
| Domain IPs | 151.101.130.152, 151.101.194.152, 151.101.2.152, 151.101.66.152 |
| Redirect IPs | 151.101.130.152, 151.101.194.152, 151.101.2.152, 151.101.66.152 |
| Response IP | 199.232.46.152 |
| Found | Yes |
| Hash | db7ac5fb4bf15de2e080bde261568de42f69654f5655ec5f34adb21612c7539c |
| SimHash | a45c9876b756 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/d/ |
| Disallow | /*/followers |
| Disallow | /*/following |
| Disallow | /*/pingback$ |
| Disallow | /*/readcasts |
| Disallow | /*/info$ |
| Disallow | /*/subscribers$ |
| Disallow | /*/friends$ |
| Disallow | /*/*/data$ |
| Disallow | /*?format=json |
| Disallow | /account/ |
| Disallow | /account-settings |
| Disallow | /analytics/ |
| Disallow | /api? |
| Disallow | /api/ |
| Disallow | /archive/ |
| Disallow | /blocks? |
| Disallow | /blocks/ |
| Disallow | /book_annotations/ |
| Disallow | /book-preview/*/recommenders |
| Disallow | /book-preview/*/shadow_loader |
| Disallow | /cpds2/ |
| Disallow | /cpspa/ |
| Disallow | /csrf_token |
| Disallow | /doc-page/animated-hero-banner-recommender-props |
| Disallow | /doc-page/download-receipt-modal-props/ |
| Disallow | /doc-page/embed-modal-props/ |
| Disallow | /doc-page/exclusive-free-trial-props/ |
| Disallow | /doc-page/flag-document-modal-props/ |
| Disallow | /doc-page/paused-user-download-modal-props |
| Disallow | /doc-page/pmp-login-join-modal-props/ |
| Disallow | /doc-page/recommenders/ |
| Disallow | /doc-page/seo-roadblock-props/ |
| Disallow | /doc/protected/ |
| Disallow | /docinfo/ |
| Disallow | /document_auxillary_content/ |
| Disallow | /document_downloads/ |
| Disallow | /documents/*/comments? |
| Disallow | /documents/search |
| Disallow | /embeds/ |
| Disallow | /events/ |
| Disallow | /explorespa/ |
| Disallow | /feeds/user_rss/ |
| Disallow | /fullscreen/ |
| Disallow | /full/ |
| Disallow | /home |
| Disallow | /job_game/ |
| Disallow | /jobs/botrace_bot/ |
| Disallow | /jobs/botrace_matches/ |
| Disallow | /jobs/botrace_my_bots |
| Disallow | /jobs/botrace_rankings |
| Disallow | /jobs/botrace_upload_bot |
| Disallow | /language? |
| Disallow | /listen/ |
| Disallow | /login? |
| Disallow | /lp-spa |
| Disallow | /next/ |
| Disallow | /notifications/ |
| Disallow | /options/exposed_to_client.js |
| Disallow | /payments/ |
| Disallow | /profiles/content.json |
| Disallow | /profiles/more_reviews |
| Disallow | /profiles/timeline? |
| Disallow | /promo_code |
| Disallow | /ratings.json |
| Disallow | /ratings$ |
| Disallow | /read/ |
| Disallow | /sbd/ |
| Disallow | /search-4gen |
| Disallow | /search-collections? |
| Disallow | /search-people? |
| Disallow | /search? |
| Disallow | /sectionized/ |
| Disallow | /ssi/geoip_cc |
| Disallow | /store_purchase |
| Disallow | /upload-document? |
| Disallow | /upload/auto |
| Disallow | /upload/throttled |
| Disallow | /upload/upload_progress/ |
| Disallow | /user_flags/ |
| Disallow | /user-document-collections/ |
| Disallow | /viewer/ |
| Disallow | /word/access_denied/ |
| Disallow | /word/add_to_favorites/ |
| Disallow | /word/comment_login/ |
| Disallow | /word/document_edit/ |
| Disallow | /word/document_stats/ |
| Disallow | /word/document_url/ |
| Disallow | /word/download/ |
| Disallow | /word/embed/ |
| Disallow | /your-account |
Other Records
| Field | Value |
|---|---|
| sitemap | https://sitemaps.scribd.com/audiobooks_de_index.xml |
| sitemap | https://sitemaps.scribd.com/audiobooks_en_index.xml |
| sitemap | https://sitemaps.scribd.com/audiobooks_es_index.xml |
| sitemap | https://sitemaps.scribd.com/audiobooks_fr_index.xml |
| sitemap | https://sitemaps.scribd.com/audiobooks_id_index.xml |
| sitemap | https://sitemaps.scribd.com/audiobooks_other_index.xml |
| sitemap | https://sitemaps.scribd.com/audiobooks_pt_index.xml |
| sitemap | https://sitemaps.scribd.com/audiobooks_ro_index.xml |
| sitemap | https://sitemaps.scribd.com/audiobooks_ru_index.xml |
| sitemap | https://sitemaps.scribd.com/books_de_index.xml |
| sitemap | https://sitemaps.scribd.com/books_en_index.xml |
| sitemap | https://sitemaps.scribd.com/books_es_index.xml |
| sitemap | https://sitemaps.scribd.com/books_fr_index.xml |
| sitemap | https://sitemaps.scribd.com/books_id_index.xml |
| sitemap | https://sitemaps.scribd.com/books_other_index.xml |
| sitemap | https://sitemaps.scribd.com/books_pt_index.xml |
| sitemap | https://sitemaps.scribd.com/books_ro_index.xml |
| sitemap | https://sitemaps.scribd.com/books_ru_index.xml |
| sitemap | https://sitemaps.scribd.com/docs_de_index.xml |
| sitemap | https://sitemaps.scribd.com/docs_en_index.xml |
| sitemap | https://sitemaps.scribd.com/docs_es_index.xml |
| sitemap | https://sitemaps.scribd.com/docs_fr_index.xml |
| sitemap | https://sitemaps.scribd.com/docs_id_index.xml |
| sitemap | https://sitemaps.scribd.com/docs_other_index.xml |
| sitemap | https://sitemaps.scribd.com/docs_pt_index.xml |
| sitemap | https://sitemaps.scribd.com/docs_ro_index.xml |
| sitemap | https://sitemaps.scribd.com/docs_ru_index.xml |
| sitemap | https://sitemaps.scribd.com/series_de_index.xml |
| sitemap | https://sitemaps.scribd.com/series_en_index.xml |
| sitemap | https://sitemaps.scribd.com/series_es_index.xml |
| sitemap | https://sitemaps.scribd.com/series_fr_index.xml |
| sitemap | https://sitemaps.scribd.com/series_id_index.xml |
| sitemap | https://sitemaps.scribd.com/series_other_index.xml |
| sitemap | https://sitemaps.scribd.com/series_pt_index.xml |
| sitemap | https://sitemaps.scribd.com/series_ro_index.xml |
| sitemap | https://sitemaps.scribd.com/series_ru_index.xml |
| sitemap | https://sitemaps.scribd.com/sheet_music_index.xml |
| sitemap | https://sitemaps.scribd.com/sheet_music_chapters_index.xml |
| sitemap | https://sitemaps.scribd.com/articles_index.xml |
| sitemap | https://sitemaps.scribd.com/podcasts_index.xml |
| sitemap | https://sitemaps.scribd.com/snapshots_index.xml |
| sitemap | https://sitemaps.scribd.com/magazines_index.xml |
| sitemap | https://sitemaps.scribd.com/users_index.xml |