fourdesire.com
robots.txt
Robots Exclusion Standard data for fourdesire.com
Resource Scan
Scan Details
| Site Domain | fourdesire.com |
| Base Domain | fourdesire.com |
| Scan Status | Ok |
| Last Scan | 2024-10-31T01:56:47+00:00 |
| Next Scan | 2024-11-07T01:56:47+00:00 |
Last Scan
| Scanned | 2024-10-31T01:56:47+00:00 |
| URL | https://fourdesire.com/robots.txt |
| Redirect | https://sparkful.app/robots.txt |
| Redirect Domain | sparkful.app |
| Redirect Base | sparkful.app |
| Domain IPs | 104.21.78.220, 172.67.137.216, 2606:4700:3036::6815:4edc, 2606:4700:3037::ac43:89d8 |
| Redirect IPs | 104.26.2.27, 104.26.3.27, 172.67.74.82, 2606:4700:20::681a:21b, 2606:4700:20::681a:31b, 2606:4700:20::ac43:4a52 |
| Response IP | 104.26.2.27 |
| Found | Yes |
| Hash | d29da22117e5153e6697fe86639e37d8962e18a697734256ec72a184b05370d4 |
| SimHash | 6b049450c7b4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /my/* |
| Disallow | /cdn-cgi* |
| Disallow | /_next/* |
| Disallow | /api/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://sparkful.app/sitemap.xml |
| sitemap | https://sparkful.app/server-sitemaps/cms.xml |
| sitemap | https://sparkful.app/server-sitemaps/universe.xml |
Warnings
- `host` is not a known field.
Comments