norpan.se
robots.txt
Robots Exclusion Standard data for norpan.se
Resource Scan
Scan Details
Site Domain | norpan.se |
Base Domain | norpan.se |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-10-03T23:35:15+00:00 |
Next Scan | 2024-10-10T23:35:15+00:00 |
Last Successful Scan
Scanned | 2024-09-25T23:30:45+00:00 |
URL | https://norpan.se/robots.txt |
Domain IPs | 185.146.22.248 |
Response IP | 185.146.22.248 |
Found | Yes |
Hash | 84a8d3b29f11b99b2e15ae21907fc186dfc9dc91f2b4954a68c78a51b831f372 |
SimHash | 61391c44e993 |
Groups
*
Rule | Path |
---|---|
Disallow | /attributes/ |
Disallow | /conn/ |
Disallow | /functions/ |
Disallow | /includes/ |
Disallow | /js/ |
Disallow | /panel/ |
Disallow | /sessions/ |
Disallow | /widgets/ |
Disallow | /medium_thumbs/ |
Disallow | /small_thumbs/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
Other Records
Field | Value |
---|---|
sitemap | http://www.norpan.se/sitemap.xml |