abifind.com
robots.txt
Robots Exclusion Standard data for abifind.com
Resource Scan
Scan Details
| Site Domain | abifind.com |
| Base Domain | abifind.com |
| Scan Status | Ok |
| Last Scan | 2026-01-09T14:16:14+00:00 |
| Next Scan | 2026-01-16T14:16:14+00:00 |
Last Scan
| Scanned | 2026-01-09T14:16:14+00:00 |
| URL | https://abifind.com/robots.txt |
| Redirect | https://www.abifind.com/robots.txt |
| Redirect Domain | www.abifind.com |
| Redirect Base | abifind.com |
| Domain IPs | 108.160.154.248 |
| Redirect IPs | 108.160.154.248 |
| Response IP | 108.160.154.248 |
| Found | Yes |
| Hash | 7675df1e70a1e51ebba96ba6b78ab4df4c18fc2ff16f8269da5fec67ce71dcd7 |
| SimHash | 252566450f71 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /add-review/ |
| Disallow | /add-url/ |
| Disallow | /addreview/ |
| Disallow | /addurl/ |
| Disallow | /articles/submit-article/ |
| Disallow | /data/ |
| Disallow | /inc/ |
| Disallow | /editor/ |
| Disallow | /listing-edit/ |
| Disallow | /listing-upgrade/ |
| Disallow | /suggest-category/ |
| Disallow | /suggestcat/ |
| Disallow | /suggestreg/ |
| Disallow | /submit/ |
| Disallow | /submit-article/ |
| Disallow | /stat/ |
| Disallow | /viewcart/ |
| Disallow | /dir/Society/Sexuality/ |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.abifind.com/sitemap_directory.xml.gz |
Warnings
- `host` is not a known field.