apilayer.com
robots.txt
Robots Exclusion Standard data for apilayer.com
Resource Scan
Scan Details
Site Domain | apilayer.com |
Base Domain | apilayer.com |
Scan Status | Ok |
Last Scan | 2025-06-24T15:42:34+00:00 |
Next Scan | 2025-07-24T15:42:34+00:00 |
Last Scan
Scanned | 2025-06-24T15:42:34+00:00 |
URL | https://apilayer.com/robots.txt |
Domain IPs | 104.26.12.134, 104.26.13.134, 172.67.70.47, 2606:4700:20::681a:c86, 2606:4700:20::681a:d86, 2606:4700:20::ac43:462f |
Response IP | 104.26.13.134 |
Found | Yes |
Hash | ec204c292f543eb76a367c74e06cc3827e5ba12a868c67f24d7ada4034aa2de0 |
SimHash | a5640c40d193 |
Groups
*
Rule | Path |
---|---|
Disallow | /marketplace/code/widget |
Disallow | /marketplace/code/response |
Disallow | /marketplace/checkout/* |
Disallow | /signup |
Disallow | /signin |
Disallow | /pass-reset |
Disallow | /recover-password |
Disallow | /marketplace/providers/* |
Disallow | /marketplace/tag/* |
Disallow | /marketplace/featured |
Disallow | /marketplace/bestseller |
Disallow | /marketplace/hot |
Disallow | /marketplace/search* |
Disallow | /widgets/* |
Disallow | /cdn-cgi/ |
Other Records
Field | Value |
---|---|
sitemap | https://apilayer.com/sitemap.xml |