aycateknik.com
robots.txt

Robots Exclusion Standard data for aycateknik.com

Resource Scan

Scan Details

Site Domain aycateknik.com
Base Domain aycateknik.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-10-12T07:04:39+00:00
Next Scan 2025-01-10T07:04:39+00:00

Last Successful Scan

Scanned2023-12-18T07:02:26+00:00
URL https://aycateknik.com/robots.txt
Redirect https://www.aycateknik.com/robots.txt
Redirect Domain www.aycateknik.com
Redirect Base aycateknik.com
Domain IPs 104.21.73.149, 172.67.163.101, 2606:4700:3035::6815:4995, 2606:4700:3035::ac43:a365
Redirect IPs 104.21.73.149, 172.67.163.101, 2606:4700:3035::6815:4995, 2606:4700:3035::ac43:a365
Response IP 104.21.73.149
Found Yes
Hash 91c8c2fb58e112d3c4057c1fc62ae29d7b680542eeb717828295337713802e28
SimHash 4c54d840c591

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

zmeu

Rule Path
Disallow /

hybrid

Rule Path
Disallow /

soup

Rule Path
Disallow /

camontspider

Rule Path
Disallow /

sweb

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.aycateknik.com/sitemap.xml

Warnings

  • `host` is not a known field.