Log In Sign Up

hangang.seoul.go.kr
robots.txt

Robots Exclusion Standard data for hangang.seoul.go.kr

Resource Scan

Scan Details

Site Domain hangang.seoul.go.kr
Base Domain seoul.go.kr
Scan Status Ok
Last Scan2024-11-03T15:45:59+00:00
Next Scan 2024-12-03T15:45:59+00:00

Last Scan

Scanned2024-11-03T15:45:59+00:00
URL https://hangang.seoul.go.kr/robots.txt
Domain IPs 115.84.164.103
Response IP 115.84.164.103
Found Yes
Hash 02eb68d90a75a5e8e1f46c2172ea45245e03b379425b3639722bdf44c9c1d3ad
SimHash 213e7954a2f2

Groups

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider+

No rules defined. All paths allowed.

ahrefsbot

Rule Path
Disallow /

livelapbot

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

flipboardrss

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

is_archiver

Rule Path
Disallow /

ogcrawler

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

feedlybot

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

zitebot

Rule Path
Disallow /

automatic.beta

Rule Path
Disallow /

bitlybot

Rule Path
Disallow /

contextad

Rule Path
Disallow /

angloinfo

Rule Path
Disallow /

umbot-ln

Rule Path
Disallow /

crazywebcrawler

Rule Path
Disallow /

xxxxxxxx

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

orangebot

Rule Path
Disallow /

crawlermanager

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin
Disallow /wp-admin/*
Disallow /wp-includes/*
Disallow /wp-content
Disallow /wp-content/*
Disallow /archives
Disallow /archives/*
Disallow /project2019
Disallow /project2019/*
Disallow /project2018
Disallow /project2018/*
Disallow /project2017
Disallow /project2017/*
Disallow /project2016
Disallow /project2016/*
Disallow /project2015
Disallow /project2015/*
Disallow /project2014
Disallow /project2014/*
Allow /www
Allow /www/*
Disallow /apage
Disallow /apage/*
Disallow /zero
Disallow /zero/*
Back to top

Other Records

Field Value
sitemap https://hangang.seoul.go.kr/sitemap.xml
Back to top

Comments

  • Baiduspider
  • AhrefsBot
  • LivelapBot
  • ShowyouBot
  • 007ac9
  • Dotbot
  • Gigabot
  • Exabot
  • CCBot
  • FlipboardRSS
  • archive.org_bot
  • Yahoo
  • is_archiver
  • ogcrawler
  • PaperLiBot
  • YandexBot
  • Blekkobot
  • FeedlyBot
  • msnbot-media
  • zitebot
  • Automatic.beta
  • bitlybot
  • ContextAd
  • AngloINFO
  • uMBot-LN
  • CRAZYWEBCRAWLER
  • xxxxxxxx
  • 360Spider
  • YisouSpider
  • OrangeBot
  • CrawlerManager
  • QuerySeekerSpider
  • SMTBot
  • global
  • DaumWebMasterTool:35bdbb08065e195945c18798291e4434f50a1b76ccd19819c9a6a7b1317911f7:E6MAtcaVqfc0tK6ARTi0pA==
Back to top

Warnings

  • 5 invalid lines.
Back to top