pl.ign.com
robots.txt
Robots Exclusion Standard data for pl.ign.com
Resource Scan
Scan Details
Site Domain | pl.ign.com |
Base Domain | ign.com |
Scan Status | Ok |
Last Scan | 2025-09-24T09:14:56+00:00 |
Next Scan | 2025-10-01T09:14:56+00:00 |
Last Scan
Scanned | 2025-09-24T09:14:56+00:00 |
URL | https://pl.ign.com/robots.txt |
Domain IPs | 23.54.118.204, 23.54.118.205 |
Response IP | 23.213.43.198 |
Found | Yes |
Hash | 351abde4ac8549bd8d1b5c31a8e19d1cba15ff2cbcd87dc6449f3a28adc9429f |
SimHash | 78511151c335 |
Groups
*
Rule | Path |
---|---|
Disallow | /*.psd$ |
Disallow | /admin/ |
Disallow | */admin/ |
Disallow | /se/ |
Disallow | /m/load_videos* |
Disallow | /m/load_articles* |
Disallow | /_views/ |
Disallow | /apiproxy/ |
Disallow | */empty/ |
Disallow | /forum/search/ |
Disallow | /debug/ |
Disallow | /sugarfif.html |
Disallow | /u/ |
msnbot
bingbot
yandex
ahrefsbot
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
ai2bot-dolma
anthropic-ai
amazonbot
applebot
applebot-extended
bytespider
ccbot
claude-web
claudebot
cohere-ai
ddm*
ddm-dcipher/1.0.7
ddm-dcipher*
diffbot
duckassistbot
facebookbot
gptbot
httrack
meta-externalagent
meta-externalfetcher
nutch
offline explorer
omgili
perplexity-user
perplexitybot
scrapy
timpibot
youbot
Rule | Path |
---|---|
Disallow | / |
Allow | /samsung-galaxy-s25-series/78156/ |
Allow | /samsung-galaxy-s25-series/78156/feature/comment-les-jeux-assistes-par-ia-sur-le-galaxy-s25-se-traduisent-par-un-temps-de-jeu-prolonge-et-des |
Allow | /samsung/218207/ |
Allow | /samsung/218207/news/experimentando-con-las-funciones-de-la-camara-galaxy-ai-como-el-modo-nocturno-la-edicion-generativa |
Allow | /samsung/218199/ |
Allow | /samsung/218199/news/asi-es-como-los-juegos-asistidos-por-ia-en-el-galaxy-s25-permiten-prolongar-el-tiempo-de-juego-y-opt |
Warnings
- 1 invalid line.
Comments