fermer.blog
robots.txt
Robots Exclusion Standard data for fermer.blog
Resource Scan
Scan Details
Site Domain | fermer.blog |
Base Domain | fermer.blog |
Scan Status | Ok |
Last Scan | 2024-09-17T16:48:15+00:00 |
Next Scan | 2024-09-24T16:48:15+00:00 |
Last Scan
Scanned | 2024-09-17T16:48:15+00:00 |
URL | https://fermer.blog/robots.txt |
Domain IPs | 54.38.155.61 |
Response IP | 54.38.155.61 |
Found | Yes |
Hash | 3397075d7873475269c47df0e078fb74a83168de611cb5821481d22652e9fc94 |
SimHash | f01548e385d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /shop$ |
Disallow | /shop/ |
Disallow | /services/analizator/ |
Disallow | /services/analizator$ |
Disallow | /ru$ |
Disallow | /en$ |
Disallow | /uk$ |
Disallow | /ru/* |
Disallow | /en/* |
Disallow | /uk/* |
Disallow | /go-to-url* |
Disallow | /goods$ |
Disallow | /goods/* |
Disallow | /*?noredir |
Disallow | /*%26noredir |
Disallow | /*?sa |
Disallow | /*%26sa |
Disallow | /*?utm |
Disallow | /*%26utm |
Disallow | /*?fake |
Disallow | /*%26fake |
Disallow | /*?pageNumPast |
Disallow | /*%26pageNumPast |
Disallow | /*~pageLink~ |
Disallow | /*~commentLink~ |
Disallow | /latest-events* |
Disallow | /stocks-archive-day* |
Disallow | /search$ |
Disallow | /search/* |
Disallow | /news/archive$ |
Disallow | /news/archive/* |
Disallow | /site/login |
Disallow | /site/login/* |
Disallow | /user/login/* |
Disallow | /user/login$ |
Disallow | /admin$ |
Disallow | /admin/* |
Other Records
Field | Value |
---|---|
sitemap | https://fermer.blog/sitemap.xml |