teklic.hr
robots.txt

Robots Exclusion Standard data for teklic.hr

Resource Scan

Scan Details

Site Domain teklic.hr
Base Domain teklic.hr
Scan Status Ok
Last Scan2024-07-03T11:28:20+00:00
Next Scan 2024-07-10T11:28:20+00:00

Last Scan

Scanned2024-07-03T11:28:20+00:00
URL https://teklic.hr/robots.txt
Redirect https://www.teklic.hr/robots.txt
Redirect Domain www.teklic.hr
Redirect Base teklic.hr
Domain IPs 178.218.166.222
Redirect IPs 178.218.166.222
Response IP 178.218.166.222
Found Yes
Hash abf2189e266298e3633560e27f90cc84bf0e3f353a712c3d66405898091e2b5e
SimHash 4908880283b3

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.teklic.hr/sitemap.xml
sitemap https://www.teklic.hr/sitemap.rss