pl.ign.com
robots.txt

Robots Exclusion Standard data for pl.ign.com

Resource Scan

Scan Details

Site Domain pl.ign.com
Base Domain ign.com
Scan Status Ok
Last Scan2025-09-24T09:14:56+00:00
Next Scan 2025-10-01T09:14:56+00:00

Last Scan

Scanned2025-09-24T09:14:56+00:00
URL https://pl.ign.com/robots.txt
Domain IPs 23.54.118.204, 23.54.118.205
Response IP 23.213.43.198
Found Yes
Hash 351abde4ac8549bd8d1b5c31a8e19d1cba15ff2cbcd87dc6449f3a28adc9429f
SimHash 78511151c335

Groups

*

Rule Path
Disallow /*.psd$
Disallow /admin/
Disallow */admin/
Disallow /se/
Disallow /m/load_videos*
Disallow /m/load_articles*
Disallow /_views/
Disallow /apiproxy/
Disallow */empty/
Disallow /forum/search/
Disallow /debug/
Disallow /sugarfif.html
Disallow /u/

msnbot
bingbot
yandex
ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ai2bot-dolma
anthropic-ai
amazonbot
applebot
applebot-extended
bytespider
ccbot
claude-web
claudebot
cohere-ai
ddm*
ddm-dcipher/1.0.7
ddm-dcipher*
diffbot
duckassistbot
facebookbot
gptbot
httrack
meta-externalagent
meta-externalfetcher
nutch
offline explorer
omgili
perplexity-user
perplexitybot
scrapy
timpibot
youbot

Rule Path
Disallow /
Allow /samsung-galaxy-s25-series/78156/
Allow /samsung-galaxy-s25-series/78156/feature/comment-les-jeux-assistes-par-ia-sur-le-galaxy-s25-se-traduisent-par-un-temps-de-jeu-prolonge-et-des
Allow /samsung/218207/
Allow /samsung/218207/news/experimentando-con-las-funciones-de-la-camara-galaxy-ai-como-el-modo-nocturno-la-edicion-generativa
Allow /samsung/218199/
Allow /samsung/218199/news/asi-es-como-los-juegos-asistidos-por-ia-en-el-galaxy-s25-permiten-prolongar-el-tiempo-de-juego-y-opt

Comments

  • Ziff Davis content is made available for your non-commercial use subject to our
  • Terms of Use here: https://www.ziffdavis.com/terms-of-use
  • Use of any robot, crawler, or other tool to scrape, harvest, extract, or retrieve any content on
  • this website using automated means is prohibited without written permission from Ziff Davis.
  • Prohibited uses include but are not limited to:
  • (1) text and data mining under Art. 4 of the EU Directive on Copyright in the Digital Single
  • Market;
  • (2) development or operation of artificial intelligence or machine learning software or
  • databases, including by training, fine-tuning, embedding, and retrieval-augmented generation;
  • (3) creating data sets containing our content or sharing it with others; and
  • (4) any commercial purposes.
  • Contact licensing@ziffdavis.com for assistance.
  • User-agent: ChatGPT-User
  • User-agent: OAI-SearchBot

Warnings

  • 1 invalid line.