Log In Sign Up

weburg.net
robots.txt

Robots Exclusion Standard data for weburg.net

Resource Scan

Scan Details

Site Domain weburg.net
Base Domain weburg.net
Scan Status Ok
Last Scan2024-09-20T04:34:54+00:00
Next Scan 2024-09-27T04:34:54+00:00

Last Scan

Scanned2024-09-20T04:34:54+00:00
URL https://weburg.net/robots.txt
Domain IPs 212.49.103.220, 2a02:17d0:8007:0:1:be60:80:f
Response IP 212.49.103.220
Found Yes
Hash cc202e7d32c8b4ae767ba508553ab5332279ec955272b6879c595e428d81eef5
SimHash 0edaac69063a

Groups

*

Rule Path Comment
Disallow /redirect/ -
Disallow /forums/tech/unix/76136 -
Disallow /tv/ts/patrul -
Disallow /search/ -
Disallow /tv/about -
Disallow /tv/media-server -
Disallow /leto ñòàðûé ñïåöïðîåêò
Disallow /mainpage ñòàðàÿ ñòàðòîâàÿ
Disallow /gallery/about î ãàëåðåÿõ, íåàêòóàëüíàÿ èíôîðìàöèÿ
Disallow /happy5 ñòàðûé ñïåöïðîåêò
Disallow /halloween ñòàðûé ñïåöïðîåêò
Disallow /help ïîìîùü ïî ïîðòàëó
Disallow /tags âñå òåãè
Disallow /awards/*/* äîïîëíèòåëüíûå ñòðàíèöû êîíêóðñîâ
Disallow /persons/*/gallery ãàëåðåè ïåðñîí
Disallow /movies/gallery/ ãàëåðåè ôèëüìîâ-ñåðèàëîâ
Disallow /? âñå GET-çàïðîñû íà ñòàðòîâîé
Disallow /magazine/? âñå GET-çàïðîñû â æóðíàëå
Disallow /magazine? âñå GET-çàïðîñû â æóðíàëå
Disallow /afisha/events/*? âñå GET-çàïðîñû â àôèøå
Disallow /awards/*? âñå GET-çàïðîñû â êîíêóðñàõ
Disallow /forums*? âñå GET-çàïðîñû â ôîðóìàõ
Disallow /audiobooks*? âñå GET-çàïðîñû â êíèãàõ
Disallow /gallery/*? âñå GET-çàïðîñû â ãàëåðåÿõ
Disallow /movies*? âñå GET-çàïðîñû â êèíî
Disallow /music*? âñå GET-çàïðîñû â ìóçûêå
Disallow /series*? âñå GET-çàïðîñû â ñåðèàëàõ
Disallow /news*? âñå GET-çàïðîñû â íîâîñòÿõ
Disallow /persons*? âñå GET-çàïðîñû â ïåðñîíàõ
Disallow /places*? âñå GET-çàïðîñû â îðãàíèçàöèÿõ
Back to top

Other Records

Field Value
sitemap https://www.weburg.net/sitemap.xml
Back to top

Comments

  • çàïðåùàåò ñòðàíèöû ñîäåðæàùèå:
  • íå çàãðóæàòü ñòðàíèöû ñ ïàðàìåòðîì date:
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top