rapidapi.com
robots.txt
Robots Exclusion Standard data for rapidapi.com
Resource Scan
Scan Details
| Site Domain | rapidapi.com |
| Base Domain | rapidapi.com |
| Scan Status | Ok |
| Last Scan | 2025-03-11T10:20:00+00:00 |
| Next Scan | 2025-04-10T10:20:00+00:00 |
Last Scan
| Scanned | 2025-03-11T10:20:00+00:00 |
| URL | https://rapidapi.com/robots.txt |
| Domain IPs | 172.66.41.24, 172.66.42.232, 2606:4700:3108::ac42:2918, 2606:4700:3108::ac42:2ae8 |
| Response IP | 172.66.42.232 |
| Found | Yes |
| Hash | b03771526ebc333b4dc31a04a555bde42a419149b9d05a9d47f5e926972db50f |
| SimHash | 00018a002927 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /search/*/related |
| Disallow | /blog/search/ |
| Disallow | /*/api/*/amp |
| Disallow | /collection/*/amp |
| Disallow | /auth/ |
| Disallow | /auth |
| Disallow | /provider/ |
| Disallow | /developer/ |
| Disallow | /org/ |
| Disallow | /iframe-apps/ |
| Disallow | /studio/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rapidapi.com/homepage-sitemaps.xml |
| sitemap | https://rapidapi.com/sitemap-category.xml |
| sitemap | https://rapidapi.com/sitemap-data-packages.xml |
| sitemap | https://rapidapi.com/sitemap-collections.xml |
| sitemap | https://rapidapi.com/blog/post-sitemap.xml |
| sitemap | https://rapidapi.com/blog/page-sitemap.xml |
| sitemap | https://rapidapi.com/blog/sitemap_index.xml |
| sitemap | https://rapidapi.com/learn/sitemap.xml |
| sitemap | https://rapidapi.com/guides/sitemap.xml |
| sitemap | https://rapidapi.com/courses/sitemap.xml |