relevant.software
robots.txt
Robots Exclusion Standard data for relevant.software
Resource Scan
Scan Details
| Site Domain | relevant.software |
| Base Domain | relevant.software |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-21T09:50:15+00:00 |
| Next Scan | 2025-11-28T09:50:15+00:00 |
Last Successful Scan
| Scanned | 2025-11-06T03:57:11+00:00 |
| URL | https://relevant.software/robots.txt |
| Domain IPs | 104.26.12.220, 104.26.13.220, 172.67.72.172, 2606:4700:20::681a:cdc, 2606:4700:20::681a:ddc, 2606:4700:20::ac43:48ac |
| Response IP | 104.26.13.220 |
| Found | Yes |
| Hash | a9e87363468d82150cd1f1a25961de3deb74c74d1c09bd06096b1701f6f6a9dc |
| SimHash | 4038dd52e687 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /*/uploads/ |
| Disallow | /cgi-bin/ |
| Disallow | /*? |
| Disallow | /search/ |
| Disallow | |
| Disallow | /wp-json/ |
| Disallow | /*%26s%3D |
| Disallow | */feed |
| Disallow | */rss |
| Disallow | /*?utm_ |
| Disallow | /*/1000 |
| Allow | /*.js |
| Allow | /*.css |
| Disallow | /*%26amp%3Bs%3D |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://relevant.software/sitemap.xml |