couponskorea.org
robots.txt

Robots Exclusion Standard data for couponskorea.org

Resource Scan

Scan Details

Site Domain couponskorea.org
Base Domain couponskorea.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-15T04:22:17+00:00
Next Scan 2024-12-14T04:22:17+00:00

Last Successful Scan

Scanned2024-08-17T04:20:52+00:00
URL https://couponskorea.org/robots.txt
Redirect https://www.couponskorea.org/robots.txt
Redirect Domain www.couponskorea.org
Redirect Base couponskorea.org
Domain IPs 104.21.79.31, 172.67.168.238, 2606:4700:3030::ac43:a8ee, 2606:4700:3031::6815:4f1f
Redirect IPs 104.21.79.31, 172.67.168.238, 2606:4700:3030::ac43:a8ee, 2606:4700:3031::6815:4f1f
Response IP 104.21.79.31
Found Yes
Hash 6297f9a13cb48a155e79f7ac8394bf1d00a4fb1688eb0195a5fa29fe613e7f3d
SimHash 411c59502420

Groups

ias-va/3.1

Rule Path
Disallow /

applebot

Rule Path
Disallow /

caliperbot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

admantx

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

hubspot links crawler 1.0

Rule Path
Disallow /

hubspot links crawler 2.0

Rule Path
Disallow /

linespider

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

seobility

Rule Path
Disallow /

microadbot/1.1

Rule Path
Disallow /

*

Rule Path
Disallow /cache/
Disallow /core/
Disallow /front/
Disallow /smarty_configs/
Disallow /vendor/
Disallow /verify/
Disallow /search/
Disallow /go-*.html*
Disallow /composer.json
Disallow /composer.lock
Disallow /apple-touch-icon.png
Disallow /gold/amiaward.gif
Disallow /apple-touch-icon-precomposed.png
Disallow /acclaim/top_state_ad_center.js

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.couponskorea.org/couponskorea_sitemap.xml

Warnings

  • 2 invalid lines.