novosibfeya.com
robots.txt
Robots Exclusion Standard data for novosibfeya.com
Resource Scan
Scan Details
Site Domain | novosibfeya.com |
Base Domain | novosibfeya.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 5/25/2025, 8:57:01 AM |
Next Scan | 8/23/2025, 8:57:01 AM |
Last Successful Scan
Scanned | 10/10/2023, 11:06:03 PM |
URL | https://novosibfeya.com/robots.txt |
Domain IPs | 104.21.34.193, 172.67.164.51, 2606:4700:3034::ac43:a433, 2606:4700:3037::6815:22c1 |
Response IP | 172.67.164.51 |
Found | Yes |
Hash | c17b3aa818896d619fa3be683f8826df7b799fb58676db1c4903a589cbd5c47d |
SimHash | e40183055c52 |
Groups
*
Rule | Path |
---|---|
Disallow | /raion$ |
Disallow | /users$ |
Disallow | /user$ |
Disallow | /login |
Disallow | /signup |
Disallow | /poisk |
Disallow | /ajax |
Disallow | /remind |
Disallow | /banner* |
Allow | /banner/*.jpg |
Other Records
Field | Value |
---|---|
sitemap | https://novosibfeya.com/sitemap.xml |