Log In Sign Up

lci.tf1.fr
robots.txt

Robots Exclusion Standard data for lci.tf1.fr

Resource Scan

Scan Details

Site Domain lci.tf1.fr
Base Domain tf1.fr
Scan Status Ok
Last Scan2025-03-30T05:21:41+00:00
Next Scan 2025-04-06T05:21:41+00:00

Last Scan

Scanned2025-03-30T05:21:41+00:00
URL https://lci.tf1.fr/robots.txt
Redirect https://www.tf1info.fr/robots.txt
Redirect Domain www.tf1info.fr
Redirect Base tf1info.fr
Domain IPs 52.223.33.19
Redirect IPs 184.87.193.93, 184.87.193.97
Response IP 23.45.207.178
Found Yes
Hash 23269ddcce5677086a93609946f5a2792d84ffc0e0aa8d484fcfd3834465faa4
SimHash 327818818e77

Groups

*

Rule Path
Disallow *-/$
Disallow */1000/
Disallow */-*.html
Disallow *Translate*
Disallow */recherche/*
Disallow */coming-next/*
Disallow */particuliers/*
Disallow */redaction/*/*/*/*
Disallow */examens/resultats/*
Disallow */mdp-reenitialisation/*
Disallow */votre-plus-beau-marche/actualite/*
Disallow /*?v=*
Disallow /*?s=*
Disallow /*?ref=*
Disallow /*?type=*
Disallow /*?page=*
Disallow /*?query=*
Disallow /*?device=*
Disallow /*Echobox%3D*
Disallow /*?orderby=*
Disallow /*?toDelete=*
Disallow /*?redirect=*
Disallow /*servicetype%3D*
Disallow /*serviceType%3D*
Disallow /*?lang=fr&error*

twitterbot
facebookexternalhit

Rule Path
Disallow

amazonbot
anthropic-ai
applebot-extended
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-training-data-crawler
dataforseobot
diffbot
duckassistbot
facebookbot
google-extended
gptbot
meta-externalfetcher
meta-externalagent
pangubot
perplexity-user
youbot

Rule Path
Disallow /

ahrefsbot
searchmetricsbot
rogerbot
deepcrawl
oncrawl
screaming frog seo spider
mj12bot
sistrix
barkrowler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.tf1info.fr/sitemap-n.xml
sitemap https://www.tf1info.fr/sitemap.xml
sitemap https://www.tf1info.fr/sitemap-pages-0.xml
Back to top

Comments

  • Robots.txt - www.tf1info.fr
  • Social Bots
  • AI Bots
  • Bots
  • .................''''''''''''''''''''',,,,,,,,;;;;;;;;;;;;::::::::::::::::::;::;;;;;;;;;;;;;;;;;,,,,,,,,,,''''''''...'dNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM
  • ................'''''''''''''''',',,,,,,,,,,,;;;;;;;;;;;;::::::::::::::::::;::;;;;;;;;;;;;;;;;;;;,,,,,,,,,,'''''''...'dNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM
  • ........,;:::::::cccccccccccccccccc;,,,,,,,,;;;;;;;:llllooooooooooooooooooolc;:;;;;;;;;;;;;;;;;;;,,,,,,;:;,''''''''..'dNMMMMMMMMMMWX0000000XWMMMMMMMMWX000000XWMMMMMMMMMMMNK000000KWMMMMMMMMWX0000000000000000000000KWMMMMMMMMMMMMWX0kxddddxkO0XWMMMMMMMMM
  • .......'dXNNNNNNNNNNNNNNNNNNNNNNNNXd,,,,,,,;;;;;;;:dXNNNNNNNNNNNNNNNNNNNNNNKo:::;;;;;;;;;;;;;;;;::lodkO0Kx;''''''''..'dNMMMMMMMMMMXc.......:KMMMMMMMMK:......,xNMMMMMMMMMWx.......;0MMMMMMMMXc......................;0MMMMMMMMWKxl;... ..';okXWMMMMM
  • .......'xWMMMMMMMMMMMMMMMMMMMMMMMMNd,,,,,,,;;;;;;;:dNMMMMMMMMMMMMMMMMMMMMMMXd::;;;;;;;;;;;;:oxkO0XNWWMMMWk;'''''''...'dNMMMMMMMMMMK; ;KMMMMMMMM0, .:OWMMMMMMMWd. 'OMMMMMMMMX: 'OMMMMMMNk:. .'lOWMMM
  • .......'xWMMMMMMMMMMMMMMMMMMMMMMMMNd,,,,,,,;;;;;;;:dNMMMMMMMMMMMMMMMMMMMMMMXd;;;;;;;;;;;;;,lKWMMMMMMMMMMWk;'''''''...'dNMMMMMMMMMMK; ;KMMMMMMMM0, .oKWMMMMMWd. 'OMMMMMMMMX: ,0MMMMWO;. .. .cKWM
  • .......'xWMMMMMMMMMMMMMMMMMMMMMMMMNd,,,,,,,;;;;;;;:dNMMMMMMMMMMMNKOOOOOOOOOxc''''''''''''''cKMMMMMMMMMMMWk,..........'dNMMMMMMMMMMK; ;KMMMMMMMM0, ,xNMMMMWd. 'OMMMMMMMMX: 'okkkkkkkkkkkkkONMMMNd. .:oxkOkxl;. ,kW
  • .......'xNWWWWWWMMMMMMMMMMMMWWWWWWXd,,,,,,,;;;;;;,,oNMMMMMMMMMMM0:...'''''''.......''''''''cKMMMMMMMMMMMWk,...........dNMMMMMMMMMMK; ;KMMMMMMMM0, .:0WMMWd. 'OMMMMMMMMX: ;KMMMMMMMMMMMMMMMMMWd. .oKWMMMMMMMN0c. 'O
  • ........;cccccoKMMMMMMMMMMMWOolllll:,'''...........cXMMMMMMMMMMMO;................'''''''''cKMMMMMMMMMMMWx,...........dNMMMMMMMMMMK; ;KMMMMMMMM0, .oXMWd. 'OMMMMMMMMX: ;KMMMMMMMMMMMMMMMMM0, 'kWMMMMMMMMMMMNd. :
  • ..............;OMMMMMMMMMMMWd'.......... .........cXMMMMMMMMMMMXkddddddl,...........''''''cKMMMMMMMMMMMWx,...........dNMMMMMMMMMMK; ;KMMMMMMMM0, ,kXo. 'OMMMMMMMMX: .ldddddddkXMMMMMMMWd. .oWMMMMMMMMMMMMMX: .
  • ..............;OMMMMMMMMMMMNo........ .........cXMMMMMMMMMMMMMMMMMMW0:.................cKMMMMMMMMMMMWx,...........dNMMMMMMMMMMK; ;KMMMMMMMM0, ,;. .:;. 'OMMMMMMMMX: 'OMMMMMMMWo. .xMMMMMMMMMMMMMMNo. .
  • ..............,kMMMMMMMMMMMNo....... .........cXMMMMMMMMMMMMMMMMMMM0:.................cKMMMMMMMMMMMWx,...........dNMMMMMMMMMMK; ;KMMMMMMMM0, .lXx,. 'OMMMMMMMMX: 'OMMMMMMMWd. .oWMMMMMMMMMMMMMXc .
  • ..............'kMMMMMMMMMMMNo..... .........cXMMMMMMMMMMMMMMMMMWW0:.................:KMMMMMMMMMMMWx,...........oNMMMMMMMMMMK; ;KMMMMMMMM0, .oNMXo. 'OMMMMMMMMX: ..''''''.:0MMMMMMMMO' 'OWMMMMMMMMMMMNd. ;
  • .........'kMMMMMMMMMMMNo... ........cXMMMMMMMMMMMXxooooooc'.................:KMMMMMMMMMMMWx,...........oNMMMMMMMMMMK; ;KMMMMMMMM0, .oWMMW0:. 'OMMMMMMMMX: ,OXXXXXXXNWMMMMMMMMNd. 'dXWMMMMMMMW0l. 'k
  • ......kMMMMMMMMMMMNo. .......cXMMMMMMMMMMMO;.........................:KMMMMMMMMMMMWx,...........oNMMMMMMMMMMK; ;KMMMMMMMM0, .oWMMMMNx,. 'OMMMMMMMMX: ;KMMMMMMMMMMMMMMMMMMNo. .'cdkO0Oko:. 'kW
  • .kWMMMMMMMMMMNo. .......cXMMMMMMMMMMMO;.........................:KMMMMMMMMMMMWx'...........oNMMMMMMMMMMK; ;KMMMMMMMM0, .lWMMMMMMKo. 'OMMMMMMMMX: ;KMMMMMMMMMMMMMMMMMMMNk;. ... .:0WM
  • .kMMMMMMMMMMMNo. ........cXMMMMMMMMMMMO;.........................:KMMMMMMMMMMMWx'...........oNMMMMMMMMMMK; ;KMMMMMMMM0, .lWMMMMMMMWO:. 'OMMMMMMMMX: ;KMMMMMMMMMMMMMMMMMMMMWXx;. .cONMMM
  • .xNWWWWWWWWNNXl. .......:KWWWWWWWWWWNO,.........................:0NWWWWWWWWWWNx'...........oNMMMMMMMMMMK:.......:KMMMMMMMM0;.......oWMMMMMMMMMNx,......,0MMMMMMMMXc.......:KMMMMMMMMMMMMMMMMMMMMMMMN0dc,.. ..;lxKWMMMMM
  • .';;;;;;;;;;;,. ........;:::::::::::;..........................';::c:::::::::,............oNMMMMMMMMMMWKOOOOOOOKWMMMMMMMMN0OOOOOOOXWMMMMMMMMMMWX0OOOOO0NMMMMMMMMWKOOOOOOOKWMMMMMMMMMMMMMMMMMMMMMMMMMMWNKOkddooodxk0XNMMMMMMMMM
  • .........................................................................oNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM
  • ..........................................................................oNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM
  • ..........................................................................oNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM
Back to top