repensadores.es
robots.txt
Robots Exclusion Standard data for repensadores.es
Resource Scan
Scan Details
Site Domain | repensadores.es |
Base Domain | repensadores.es |
Scan Status | Ok |
Last Scan | 2024-09-24T06:52:03+00:00 |
Next Scan | 2024-10-01T06:52:03+00:00 |
Last Scan
Scanned | 2024-09-24T06:52:03+00:00 |
URL | https://repensadores.es/robots.txt |
Domain IPs | 104.21.35.250, 172.67.181.196, 2606:4700:3031::ac43:b5c4, 2606:4700:3033::6815:23fa |
Response IP | 104.21.35.250 |
Found | Yes |
Hash | ec069ac117d479db86b13c1f9e3bd3f552b576a538828564fbf9e8b7f9e6b4fc |
SimHash | 7bcfd450ca28 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | *.csv |
Other Records
Field | Value |
---|---|
sitemap | https://repensadores.es/sitemap.xml |