Log In Sign Up

halflife.wikia.com
robots.txt

Robots Exclusion Standard data for halflife.wikia.com

Resource Scan

Scan Details

Site Domain halflife.wikia.com
Base Domain wikia.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-26T21:48:05+00:00
Next Scan 2025-10-10T21:48:05+00:00

Last Successful Scan

Scanned2025-07-09T14:24:37+00:00
URL https://halflife.wikia.com/robots.txt
Redirect https://half-life.fandom.com/robots.txt
Redirect Domain half-life.fandom.com
Redirect Base fandom.com
Domain IPs 151.101.0.194, 151.101.128.194, 151.101.192.194, 151.101.64.194, 2a04:4e42:200::194, 2a04:4e42:400::194, 2a04:4e42:600::194, 2a04:4e42::194
Redirect IPs 199.232.208.194, 199.232.212.194
Response IP 199.232.208.194
Found Yes
Hash ef38e11bbef19436f93eee0c04ca3b26c52c786e676449ca9d9f93b88d39e7b5
SimHash 678cdb4089b0

Groups

semrushbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

*

Rule Path
Allow /api.php?
Allow /api.php?action=
Allow /api.php?*&action=
Allow /wiki/Special%3ACreateNewWiki
Allow /wiki/Special%3AAllMaps
Allow /it/api.php?
Allow /it/api.php?action=
Allow /it/api.php?*&action=
Allow /it/wiki/Speciale%3ACreateNewWiki
Allow /it/wiki/Special%3ACreateNewWiki
Allow /it/wiki/Speciale%3AAllMaps
Allow /it/wiki/Special%3AAllMaps
Allow /ko/api.php?
Allow /ko/api.php?action=
Allow /ko/api.php?*&action=
Allow /ko/wiki/%ED%8A%B9%EC%88%98%3ACreateNewWiki
Allow /ko/wiki/Special%3ACreateNewWiki
Allow /ko/wiki/%ED%8A%B9%EC%88%98%3AAllMaps
Allow /ko/wiki/Special%3AAllMaps
Allow /lt/api.php?
Allow /lt/api.php?action=
Allow /lt/api.php?*&action=
Allow /lt/wiki/Special%3ACreateNewWiki
Allow /lt/wiki/Special%3AAllMaps
Allow /pl/api.php?
Allow /pl/api.php?action=
Allow /pl/api.php?*&action=
Allow /pl/wiki/Specjalna%3ACreateNewWiki
Allow /pl/wiki/Special%3ACreateNewWiki
Allow /pl/wiki/Specjalna%3AAllMaps
Allow /pl/wiki/Special%3AAllMaps
Disallow /wiki/Special%3A
Disallow /wiki/User_talk%3A
Disallow /wiki/Template%3A
Disallow /wiki/Template_talk%3A
Disallow /wiki/Help%3A
Disallow /wiki/User%3A
Disallow /wiki/UserProfile%3A
Disallow /it/wiki/Speciale%3A
Disallow /it/wiki/Special%3A
Disallow /it/wiki/Discussioni_utente%3A
Disallow /it/wiki/User_talk%3A
Disallow /it/wiki/Template%3A
Disallow /it/wiki/Discussioni_template%3A
Disallow /it/wiki/Template_talk%3A
Disallow /it/wiki/Aiuto%3A
Disallow /it/wiki/Help%3A
Disallow /it/wiki/Utente%3A
Disallow /it/wiki/User%3A
Disallow /it/wiki/UserProfile%3A
Disallow /ko/wiki/%ED%8A%B9%EC%88%98%3A
Disallow /ko/wiki/Special%3A
Disallow /ko/wiki/%EC%82%AC%EC%9A%A9%EC%9E%90%ED%86%A0%EB%A1%A0%3A
Disallow /ko/wiki/User_talk%3A
Disallow /ko/wiki/%ED%8B%80%3A
Disallow /ko/wiki/Template%3A
Disallow /ko/wiki/%ED%8B%80%ED%86%A0%EB%A1%A0%3A
Disallow /ko/wiki/Template_talk%3A
Disallow /ko/wiki/%EB%8F%84%EC%9B%80%EB%A7%90%3A
Disallow /ko/wiki/Help%3A
Disallow /ko/wiki/%EC%82%AC%EC%9A%A9%EC%9E%90%3A
Disallow /ko/wiki/User%3A
Disallow /ko/wiki/UserProfile%3A
Disallow /lt/wiki/Special%3A
Disallow /lt/wiki/User_talk%3A
Disallow /lt/wiki/Template%3A
Disallow /lt/wiki/Template_talk%3A
Disallow /lt/wiki/Help%3A
Disallow /lt/wiki/User%3A
Disallow /lt/wiki/UserProfile%3A
Disallow /pl/wiki/Specjalna%3A
Disallow /pl/wiki/Special%3A
Disallow /pl/wiki/Dyskusja_u%C5%BCytkownika%3A
Disallow /pl/wiki/User_talk%3A
Disallow /pl/wiki/Szablon%3A
Disallow /pl/wiki/Template%3A
Disallow /pl/wiki/Dyskusja_szablonu%3A
Disallow /pl/wiki/Template_talk%3A
Disallow /pl/wiki/Pomoc%3A
Disallow /pl/wiki/Help%3A
Disallow /pl/wiki/U%C5%BCytkownik%3A
Disallow /pl/wiki/User%3A
Disallow /pl/wiki/UserProfile%3A

ias_crawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://half-life.fandom.com/sitemap-newsitemapxml-index.xml
sitemap https://half-life.fandom.com/it/sitemap-newsitemapxml-index.xml
sitemap https://half-life.fandom.com/ko/sitemap-newsitemapxml-index.xml
sitemap https://half-life.fandom.com/lt/sitemap-newsitemapxml-index.xml
sitemap https://half-life.fandom.com/pl/sitemap-newsitemapxml-index.xml
Back to top

Warnings

  • `noindex` is not a known field.
Back to top