sivas-yemekleri.com
robots.txt

Robots Exclusion Standard data for sivas-yemekleri.com

Resource Scan

Scan Details

Site Domain sivas-yemekleri.com
Base Domain sivas-yemekleri.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-07T06:57:32+00:00
Next Scan 2024-11-05T06:57:32+00:00

Last Successful Scan

Scanned2024-04-10T06:53:00+00:00
URL https://sivas-yemekleri.com/robots.txt
Domain IPs 104.21.86.210, 172.67.136.223, 2606:4700:3031::6815:56d2, 2606:4700:3034::ac43:88df
Response IP 172.67.136.223
Found Yes
Hash fe7b5ae112fa22c7e8e6ce30ee3649be452ff8d988736a71ca53d504e0613839
SimHash 23cc4d25cdf2

Groups

*

Rule Path
Disallow */page*.php$
Disallow /map*.php$
Disallow /sitemap*.php$

Other Records

Field Value
sitemap https://sivas-yemekleri.com/sitemap.xml
sitemap https://sivas-yemekleri.com/news/sitemap.xml
sitemap https://sivas-yemekleri.com/c1/sitemap.xml
sitemap https://sivas-yemekleri.com/c2/sitemap.xml
sitemap https://sivas-yemekleri.com/c3/sitemap.xml
sitemap https://sivas-yemekleri.com/c4/sitemap.xml
sitemap https://sivas-yemekleri.com/c5/sitemap.xml
sitemap https://sivas-yemekleri.com/c6/sitemap.xml
sitemap https://sivas-yemekleri.com/c7/sitemap.xml
sitemap https://sivas-yemekleri.com/c8/sitemap.xml
sitemap https://sivas-yemekleri.com/c9/sitemap.xml
sitemap https://sivas-yemekleri.com/c10/sitemap.xml
sitemap https://sivas-yemekleri.com/c11/sitemap.xml
sitemap https://sivas-yemekleri.com/c12/sitemap.xml
sitemap https://sivas-yemekleri.com/c13/sitemap.xml
sitemap https://sivas-yemekleri.com/c14/sitemap.xml
sitemap https://sivas-yemekleri.com/c15/sitemap.xml
sitemap https://sivas-yemekleri.com/c16/sitemap.xml
sitemap https://sivas-yemekleri.com/c17/sitemap.xml
sitemap https://sivas-yemekleri.com/c18/sitemap.xml
sitemap https://sivas-yemekleri.com/c19/sitemap.xml
sitemap https://sivas-yemekleri.com/c20/sitemap.xml
sitemap https://sivas-yemekleri.com/c21/sitemap.xml

Warnings

  • `host` is not a known field.