nitra24.sk
robots.txt

Robots Exclusion Standard data for nitra24.sk

Resource Scan

Scan Details

Site Domain nitra24.sk
Base Domain nitra24.sk
Scan Status Ok
Last Scan2024-11-14T14:01:54+00:00
Next Scan 2024-11-21T14:01:54+00:00

Last Scan

Scanned2024-11-14T14:01:54+00:00
URL https://nitra24.sk/robots.txt
Redirect https://nitra.dnes24.sk/robots.txt
Redirect Domain nitra.dnes24.sk
Redirect Base dnes24.sk
Domain IPs 109.71.69.113
Redirect IPs 109.71.69.113
Response IP 109.71.69.113
Found Yes
Hash 2b92ecc7e27a9f73e91bb6efecd5a2ca60941ccf38aeafc7f08d4c41193e1c74
SimHash a86e94448c73

Groups

*

Rule Path
Disallow /ucet/
Disallow /registracia
Disallow /prihlasenie
Disallow /odhlasenie
Disallow /zabudnute-heslo
Disallow /account/facebook-login
Disallow /web-push-subscribe
Disallow /web-push-unsubscribe
Disallow /vyhladavanie
Disallow /zabava/kvizy/

Other Records

Field Value
crawl-delay 1

facebookexternalhit

Rule Path
Disallow /ucet/
Disallow /registracia
Disallow /prihlasenie
Disallow /odhlasenie
Disallow /zabudnute-heslo
Disallow /account/facebook-login
Disallow /web-push-subscribe
Disallow /web-push-unsubscribe
Disallow /vyhladavanie
Disallow /zabava/kvizy/

Other Records

Field Value
sitemap https://nitra.dnes24.ostatne.dnes24.sk/sitemap.xml
sitemap https://nitra.dnes24.ostatne.dnes24.sk/sitemap-2.xml
sitemap https://nitra.dnes24.ostatne.dnes24.sk/sitemap-3.xml
sitemap https://nitra.dnes24.ostatne.dnes24.sk/sitemap-4.xml

Comments

  • see http://www.robotstxt.org/orig.html for documentation