smorgon.by
robots.txt

Robots Exclusion Standard data for smorgon.by

Resource Scan

Scan Details

Site Domain smorgon.by
Base Domain smorgon.by
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-13T17:23:37+00:00
Next Scan 2026-03-13T17:23:37+00:00

Last Successful Scan

Scanned2025-05-18T09:21:36+00:00
URL https://smorgon.by/robots.txt
Domain IPs 93.125.99.2
Response IP 93.125.99.2
Found Yes
Hash 81715c8d902f408aa429e822c480cf04936f4b7fd99f636db8aca3ff08e0c11b
SimHash e8908c5c8a92

Groups

*

Rule Path
Disallow /avatar/*
Disallow /user/*
Disallow /js/*

Other Records

Field Value
sitemap https://smorgon.by/news/sitemap.xml
sitemap https://smorgon.by/hronika/sitemap.xml
sitemap https://smorgon.by/board/sitemap.xml
sitemap https://smorgon.by/video/sitemap.xml
sitemap https://smorgon.by/forum/sitemap.xml
sitemap https://smorgon.by/fotki/sitemap.php

Warnings

  • `clean-param` is not a known field.