wildtangent.kr
robots.txt

Robots Exclusion Standard data for wildtangent.kr

Resource Scan

Scan Details

Site Domain wildtangent.kr
Base Domain wildtangent.kr
Scan Status Ok
Last Scan2024-11-07T15:11:34+00:00
Next Scan 2024-11-14T15:11:34+00:00

Last Scan

Scanned2024-11-07T15:11:34+00:00
URL https://wildtangent.kr/robots.txt
Redirect https://www.wildtangent.com/robots.txt
Redirect Domain www.wildtangent.com
Redirect Base wildtangent.com
Domain IPs 3.164.85.33, 3.164.85.57, 3.164.85.73, 3.164.85.76
Redirect IPs 104.22.8.18, 104.22.9.18, 172.67.4.15, 2606:4700:10::6816:812, 2606:4700:10::6816:912, 2606:4700:10::ac43:40f
Response IP 104.22.8.18
Found Yes
Hash 5df5fd693cf6ac9d3e60b5e8554731f4477e94e6a49610aebe35d1a1844bc8a2
SimHash 77124910c3c5

Groups

*

Rule Path
Disallow /account.php
Disallow /cart.php
Disallow /checkout.php
Disallow /checkout
Disallow /finishorder.php
Disallow /login.php
Disallow /orderstatus.php
Disallow /postreview.php
Disallow /productimage.php
Disallow /productupdates.php
Disallow /remote.php
Disallow /search.php
Disallow /viewfile.php
Disallow /wishlist.php
Disallow /admin/
Disallow /__socialshop/
Disallow /welcome-to-wildtangent/
Disallow /privacy-policy/
Disallow /terms-of-use/
Disallow /safe-shopping/
Disallow /eula/
Disallow /open-source-licenses/
Disallow /sitemap.php
Disallow /shipping-returns/
Disallow /cookie-usage/
Disallow /hp-jumpstart-free-game/
Disallow /hp-jumpstart-bogo-daa/
Disallow /hp-jumpstart-bogo-hmf/
Disallow /hp-jumpstart-bogo-ldf/
Disallow /hp-jumpstart-bogo-vapr/
Disallow /hp-jumpstart-bogo-abnpp/
Disallow /hp-jumpstart-free-game/
Disallow /hp-gaminghub-sale-games/
Disallow /gamigo-fate/
Disallow /welcome-screenseven-customers/
Disallow /legal/*
Disallow /promo/*
Disallow /s/*

*

Rule Path
Disallow /*?_bc_fsnf=1*
Disallow /*%26_bc_fsnf%3D1*

ai2bot
ai2bot-dolma
amazonbot
applebot
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
diffbot
facebookbot
friendlycrawler
gptbot
google-extended
googleother
googleother-image
googleother-video
icc-crawler
isscyberriskcrawler
imagesiftbot
kangaroo bot
meta-externalagent
meta-externalfetcher
oai-searchbot
perplexitybot
petalbot
scrapy
sidetrade indexer bot
timpibot
velenpublicwebcrawler
webzio-extended
youbot
anthropic-ai
cohere-ai
facebookexternalhit
iaskspider/2.0
img2dataset
omgili
omgilibot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.wildtangent.com/xmlsitemap.php