forbes.cl
robots.txt
Robots Exclusion Standard data for forbes.cl
Resource Scan
Scan Details
Site Domain | forbes.cl |
Base Domain | forbes.cl |
Scan Status | Ok |
Last Scan | 2024-11-12T06:32:33+00:00 |
Next Scan | 2024-11-19T06:32:33+00:00 |
Last Scan
Scanned | 2024-11-12T06:32:33+00:00 |
URL | https://forbes.cl/robots.txt |
Domain IPs | 104.21.1.235, 172.67.152.147, 2606:4700:3030::ac43:9893, 2606:4700:3035::6815:1eb |
Response IP | 104.21.1.235 |
Found | Yes |
Hash | 56a33b0850c29ae0b822cddf39ac2d1b9cb103ac5f1de81996c08360e875ecd5 |
SimHash | 411c5073fb93 |
Groups
*
Rule | Path |
---|---|
Allow | /* |
Disallow | /search/ |
Disallow | /api/ |
Other Records
Field | Value |
---|---|
sitemap | https://forbes.cl/sitemap/sitemap.xml |
Comments