amu.edu.pl
robots.txt

Robots Exclusion Standard data for amu.edu.pl

Resource Scan

Scan Details

Site Domain amu.edu.pl
Base Domain amu.edu.pl
Scan Status Ok
Last Scan2025-03-21T12:19:08+00:00
Next Scan 2025-04-20T12:19:08+00:00

Last Scan

Scanned2025-03-21T12:19:08+00:00
URL https://amu.edu.pl/robots.txt
Domain IPs 150.254.65.170
Response IP 150.254.65.170
Found Yes
Hash 382d3167a3c08c3ef59108d483209e0ef1df50a38d8dc16a424a78220ea11d0c
SimHash b80afa02e92b

Groups

*

Rule Path
Disallow /*?sq_content_src=
Disallow /_web_designs
Disallow /_designs
Disallow /_web_service
Disallow /_resources
Disallow /resources
Disallow /strona-glowna
Disallow /szukaj
Disallow /media-folder
Disallow /squiz-test
Disallow /squiz-sandbox
Disallow /newsletter
Disallow /Wydzial-Fizyki
Disallow /Wydzial-Studiow-Edukacyjnych
Disallow /Wydzial-Neofilologii
Disallow /ijilrom
Disallow /wpa
Disallow /teologia
Disallow /psychologia
Disallow /cnbm
Disallow /centrumhs

Other Records

Field Value
crawl-delay 5

slurp

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Warnings

  • `request-rate` is not a known field.
  • `visit-time` is not a known field.