lightiron.nimenhuuto.com
robots.txt

Robots Exclusion Standard data for lightiron.nimenhuuto.com

Resource Scan

Scan Details

Site Domain lightiron.nimenhuuto.com
Base Domain nimenhuuto.com
Scan Status Ok
Last Scan2025-12-20T17:35:40+00:00
Next Scan 2026-01-03T17:35:40+00:00

Last Scan

Scanned2025-12-20T17:35:40+00:00
URL https://lightiron.nimenhuuto.com/robots.txt
Domain IPs 54.154.91.134
Response IP 54.154.91.134
Found Yes
Hash 4ee4002701cdfa0169b2151e8ac2d2ea6d17a75ca91c76abc872b18ee4424bb2
SimHash 6b17baa07311

Groups

*

Rule Path
Disallow /main/team_name_url
Disallow /password_forgot
Disallow /common
Disallow /advert_click
Disallow /advert
Disallow /private_team_files
Disallow /map/static
Disallow /team_s/
Disallow /main_pwa/
Disallow /events
Disallow /calendar/monthly
Disallow /calendar/widget
Disallow /messages
Disallow /players
Disallow /team_files

Other Records

Field Value
crawl-delay 10

gptbot

Rule Path
Disallow /main/team_name_url
Disallow /password_forgot
Disallow /common
Disallow /advert_click
Disallow /advert
Disallow /private_team_files
Disallow /map/static
Disallow /team_s/
Disallow /main_pwa/
Disallow /events
Disallow /calendar/monthly
Disallow /calendar/widget
Disallow /messages
Disallow /players
Disallow /team_files

Other Records

Field Value
crawl-delay 10

imagesiftbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /main/team_name_url
Disallow /password_forgot
Disallow /common
Disallow /advert_click
Disallow /advert
Disallow /private_team_files
Disallow /map/static

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Disallow /main/team_name_url
Disallow /password_forgot
Disallow /common
Disallow /advert_click
Disallow /advert
Disallow /private_team_files
Disallow /map/static

Other Records

Field Value
crawl-delay 1

yandex

Rule Path
Disallow /main/team_name_url
Disallow /password_forgot
Disallow /common
Disallow /advert_click
Disallow /advert
Disallow /private_team_files
Disallow /map/static

Other Records

Field Value
crawl-delay 1

yandexbot

Rule Path
Disallow /main/team_name_url
Disallow /password_forgot
Disallow /common
Disallow /advert_click
Disallow /advert
Disallow /private_team_files
Disallow /map/static

Other Records

Field Value
crawl-delay 1

duckduckbot

Rule Path
Disallow /main/team_name_url
Disallow /password_forgot
Disallow /common
Disallow /advert_click
Disallow /advert
Disallow /private_team_files
Disallow /map/static

Other Records

Field Value
crawl-delay 1

slurp

Rule Path
Disallow /main/team_name_url
Disallow /password_forgot
Disallow /common
Disallow /advert_click
Disallow /advert
Disallow /private_team_files
Disallow /map/static

Other Records

Field Value
crawl-delay 1

qwantify

Rule Path
Disallow /main/team_name_url
Disallow /password_forgot
Disallow /common
Disallow /advert_click
Disallow /advert
Disallow /private_team_files
Disallow /map/static

Other Records

Field Value
crawl-delay 1

chatgpt-user

Rule Path
Disallow /main/team_name_url
Disallow /password_forgot
Disallow /common
Disallow /advert_click
Disallow /advert
Disallow /private_team_files
Disallow /map/static

Other Records

Field Value
crawl-delay 1

mediapartners-google

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

adsbot-google-mobile

Rule Path
Disallow

msnbot-media

Rule Path
Disallow

google-display-ads-bot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow