xfobo.com
robots.txt
Robots Exclusion Standard data for xfobo.com
Resource Scan
Scan Details
| Site Domain | xfobo.com |
| Base Domain | xfobo.com |
| Scan Status | Ok |
| Last Scan | 2024-05-02T03:32:03+00:00 |
| Next Scan | 2024-06-01T03:32:03+00:00 |
Last Scan
| Scanned | 2024-05-02T03:32:03+00:00 |
| URL | https://xfobo.com/robots.txt |
| Domain IPs | 104.21.233.187, 104.21.233.188, 2606:4700:3038::6815:e9bb, 2606:4700:3038::6815:e9bc |
| Response IP | 104.21.233.188 |
| Found | Yes |
| Hash | 8f2596d1efef471e806abcd6419dbcc9454c285b445e7cfe8903462ac6abe189 |
| SimHash | 2a5afb300731 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /$ |
| Allow | /index.php |
| Allow | /showthread.php?t= |
| Allow | /forumdisplay.php?f= |
| Allow | /images |
| Allow | /clientscript |
| Allow | /sitemap |
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://xfobo.com/sitemap_index.xml.gz |
Warnings
- 2 invalid lines.
- `clean-param` is not a known field.
- `host` is not a known field.