nuke.com
robots.txt

Robots Exclusion Standard data for nuke.com

Resource Scan

Scan Details

Site Domain nuke.com
Base Domain nuke.com
Scan Status Ok
Last Scan2024-11-15T08:16:24+00:00
Next Scan 2024-11-22T08:16:24+00:00

Last Scan

Scanned2024-11-15T08:16:24+00:00
URL https://nuke.com/robots.txt
Redirect https://www.giantbomb.com/robots.txt
Redirect Domain www.giantbomb.com
Redirect Base giantbomb.com
Domain IPs 199.232.208.194, 199.232.212.194
Redirect IPs 199.232.208.194, 199.232.212.194
Response IP 199.232.44.194
Found Yes
Hash aa6cc85e6871887661c103676937509dfb9853626b01c9a32a6b6359ad003228
SimHash d35c99517380

Groups

ahrefsbot

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

*

Rule Path
Allow /api/$
Disallow /api/*
Disallow /notifications/
Disallow /search/
Disallow *login%3D*
Disallow /videos/embed
Disallow /videos/feed/
Disallow /podcast-xml/*premium*
Disallow /wiki/moderation/
Disallow /postRender
Disallow /forums/*/flag/
Disallow /forums/*/delete/
Disallow /forums/*/edit/
Disallow /forums/*/lock/
Disallow /forums/*/anchor/
Disallow /forums/*/add-to-favorite/
Disallow /forums/*/best-answer/*/
Disallow /jsonsearch/
Disallow /chat/

Comments

  • robots.txt for https://www.giantbomb.com/