wildtangent.in
robots.txt
Robots Exclusion Standard data for wildtangent.in
Resource Scan
Scan Details
Site Domain | wildtangent.in |
Base Domain | wildtangent.in |
Scan Status | Ok |
Last Scan | 2024-11-02T08:24:25+00:00 |
Next Scan | 2024-11-09T08:24:25+00:00 |
Last Scan
Scanned | 2024-11-02T08:24:25+00:00 |
URL | https://wildtangent.in/robots.txt |
Redirect | https://www.wildtangent.com/robots.txt |
Redirect Domain | www.wildtangent.com |
Redirect Base | wildtangent.com |
Domain IPs | 65.9.112.30, 65.9.112.4, 65.9.112.40, 65.9.112.70 |
Redirect IPs | 104.22.8.18, 104.22.9.18, 172.67.4.15, 2606:4700:10::6816:812, 2606:4700:10::6816:912, 2606:4700:10::ac43:40f |
Response IP | 104.22.8.18 |
Found | Yes |
Hash | 5df5fd693cf6ac9d3e60b5e8554731f4477e94e6a49610aebe35d1a1844bc8a2 |
SimHash | 77124910c3c5 |
Groups
*
Rule | Path |
---|---|
Disallow | /account.php |
Disallow | /cart.php |
Disallow | /checkout.php |
Disallow | /checkout |
Disallow | /finishorder.php |
Disallow | /login.php |
Disallow | /orderstatus.php |
Disallow | /postreview.php |
Disallow | /productimage.php |
Disallow | /productupdates.php |
Disallow | /remote.php |
Disallow | /search.php |
Disallow | /viewfile.php |
Disallow | /wishlist.php |
Disallow | /admin/ |
Disallow | /__socialshop/ |
Disallow | /welcome-to-wildtangent/ |
Disallow | /privacy-policy/ |
Disallow | /terms-of-use/ |
Disallow | /safe-shopping/ |
Disallow | /eula/ |
Disallow | /open-source-licenses/ |
Disallow | /sitemap.php |
Disallow | /shipping-returns/ |
Disallow | /cookie-usage/ |
Disallow | /hp-jumpstart-free-game/ |
Disallow | /hp-jumpstart-bogo-daa/ |
Disallow | /hp-jumpstart-bogo-hmf/ |
Disallow | /hp-jumpstart-bogo-ldf/ |
Disallow | /hp-jumpstart-bogo-vapr/ |
Disallow | /hp-jumpstart-bogo-abnpp/ |
Disallow | /hp-jumpstart-free-game/ |
Disallow | /hp-gaminghub-sale-games/ |
Disallow | /gamigo-fate/ |
Disallow | /welcome-screenseven-customers/ |
Disallow | /legal/* |
Disallow | /promo/* |
Disallow | /s/* |
*
Rule | Path |
---|---|
Disallow | /*?_bc_fsnf=1* |
Disallow | /*%26_bc_fsnf%3D1* |
ai2bot
ai2bot-dolma
amazonbot
applebot
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
diffbot
facebookbot
friendlycrawler
gptbot
google-extended
googleother
googleother-image
googleother-video
icc-crawler
isscyberriskcrawler
imagesiftbot
kangaroo bot
meta-externalagent
meta-externalfetcher
oai-searchbot
perplexitybot
petalbot
scrapy
sidetrade indexer bot
timpibot
velenpublicwebcrawler
webzio-extended
youbot
anthropic-ai
cohere-ai
facebookexternalhit
iaskspider/2.0
img2dataset
omgili
omgilibot
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.wildtangent.com/xmlsitemap.php |