moskisvet.com
robots.txt
Robots Exclusion Standard data for moskisvet.com
Resource Scan
Scan Details
Site Domain | moskisvet.com |
Base Domain | moskisvet.com |
Scan Status | Ok |
Last Scan | 2024-10-25T22:37:19+00:00 |
Next Scan | 2024-11-08T22:37:19+00:00 |
Last Scan
Scanned | 2024-10-25T22:37:19+00:00 |
URL | https://www.moskisvet.com/robots.txt |
Domain IPs | 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133 |
Response IP | 199.232.46.133 |
Found | Yes |
Hash | bca9c8867226f3f934ad33677ab9e025279d84ca9386b96caf4962903c310296 |
SimHash | 6c00d8648f92 |
Groups
*
Rule | Path |
---|---|
Disallow | /iskanje |
Disallow | /bin/ |
Disallow | /lbin/ |
Disallow | /adserver/ |
Disallow | /users/ |
Disallow | *modal%3A* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://www.moskisvet.com/sitemaps/sites/30001 |