levanteud.com
robots.txt

Robots Exclusion Standard data for levanteud.com

Resource Scan

Scan Details

Site Domain levanteud.com
Base Domain levanteud.com
Scan Status Ok
Last Scan2024-11-18T19:20:57+00:00
Next Scan 2024-12-02T19:20:57+00:00

Last Scan

Scanned2024-11-18T19:20:57+00:00
URL https://levanteud.com/robots.txt
Redirect https://www.levanteud.com/robots.txt
Redirect Domain www.levanteud.com
Redirect Base levanteud.com
Domain IPs 20.105.94.191
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash f20e9a4f3d0c2779e65978bd4e09a487cd70219373ed22d5cebddb972c5e5fd8
SimHash 890c4c70cfb3

Groups

*

Rule Path
Disallow /api/
Disallow /preview/
Disallow /_next/

googlebot, bingbot, yahooslurp

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.levanteud.com/sitemap.xml