uj.edu.pl
robots.txt
Robots Exclusion Standard data for uj.edu.pl
Resource Scan
Scan Details
Site Domain | uj.edu.pl |
Base Domain | uj.edu.pl |
Scan Status | Ok |
Last Scan | 2024-11-06T17:10:55+00:00 |
Next Scan | 2024-12-06T17:10:55+00:00 |
Last Scan
Scanned | 2024-11-06T17:10:55+00:00 |
URL | https://uj.edu.pl/robots.txt |
Redirect | https://www.uj.edu.pl/robots.txt |
Redirect Domain | www.uj.edu.pl |
Redirect Base | uj.edu.pl |
Domain IPs | 149.156.169.67 |
Redirect IPs | 149.156.169.67 |
Response IP | 149.156.169.67 |
Found | Yes |
Hash | 5dc6e29726968f27333c5ebb72623b1e9fd79d6bac26e51b01b4fa3aa33090f0 |
SimHash | cb0d46b277c0 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
googlebot
Rule | Path |
---|---|
Allow | / |
Disallow | /web/ |
Disallow | /group/ |
Disallow | /c/document_library/ |
Disallow | /c/portal/ |
Disallow | /html/portlet |
Disallow | /html/js |
Disallow | /uj-main-site-portlet/ |
Disallow | /notifications-portlet/ |
google favicon
Rule | Path |
---|---|
Allow | / |
Disallow | /web/ |
Disallow | /group/ |
Disallow | /c/document_library/ |
Disallow | /c/portal/ |
Disallow | /html/portlet |
Disallow | /html/js |
Disallow | /uj-main-site-portlet/ |
Disallow | /notifications-portlet/ |
googlebot-image
Rule | Path |
---|---|
Allow | / |
Disallow | /web/ |
Disallow | /group/ |
Disallow | /c/document_library/ |
Disallow | /c/portal/ |
Disallow | /html/portlet |
Disallow | /html/js |
Disallow | /uj-main-site-portlet/ |
Disallow | /notifications-portlet/ |
googlebot-news
Rule | Path |
---|---|
Allow | / |
Disallow | /web/ |
Disallow | /group/ |
Disallow | /c/document_library/ |
Disallow | /c/portal/ |
Disallow | /html/portlet |
Disallow | /html/js |
Disallow | /uj-main-site-portlet/ |
Disallow | /notifications-portlet/ |
googlebot-mobile
Rule | Path |
---|---|
Allow | / |
Disallow | /web/ |
Disallow | /group/ |
Disallow | /c/document_library/ |
Disallow | /c/portal/ |
Disallow | /html/portlet |
Disallow | /html/js |
Disallow | /uj-main-site-portlet/ |
Disallow | /notifications-portlet/ |
bingbot
Rule | Path |
---|---|
Allow | / |
Disallow | /*? |
Disallow | /web/ |
Disallow | /group/ |
Disallow | /c/document_library/ |
Disallow | /c/portal/ |
Disallow | /html/portlet |
Disallow | /html/js |
Disallow | /uj-main-site-portlet/ |
Disallow | /notifications-portlet/ |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
Comments