tf1info.fr
robots.txt

Robots Exclusion Standard data for tf1info.fr

Resource Scan

Scan Details

Site Domain tf1info.fr
Base Domain tf1info.fr
Scan Status Ok
Last Scan2024-05-16T05:19:29+00:00
Next Scan 2024-05-23T05:19:29+00:00

Last Scan

Scanned2024-05-16T05:19:29+00:00
URL https://tf1info.fr/robots.txt
Redirect https://www.tf1info.fr/robots.txt
Redirect Domain www.tf1info.fr
Redirect Base tf1info.fr
Domain IPs 52.223.33.19
Redirect IPs 72.247.127.216, 72.247.127.224
Response IP 23.202.33.96
Found Yes
Hash 6b9522f6f53a0e211b857a0bf2e5c4cc43a5c0645da263494de50d2bea33f65d
SimHash 727a18ad4c53

Groups

*

Rule Path
Disallow */1000
Disallow *Translate*
Disallow */recherche/*
Disallow */coming-next/*
Disallow */particuliers/*
Disallow */redaction/*/*/*/*
Disallow */examens/resultats/*
Disallow */mdp-reenitialisation/*
Disallow /*?v=*
Disallow /*?s=*
Disallow /*?ref=*
Disallow /*?type=*
Disallow /*?page=*
Disallow /*?query=*
Disallow /*?device=*
Disallow /*Echobox%3D*
Disallow /*?orderby=*
Disallow /*?toDelete=*
Disallow /*?redirect=*
Disallow /*servicetype%3D*
Disallow /*serviceType%3D*
Disallow /*?lang=fr&error*

twitterbot

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

oncrawl

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.tf1info.fr/sitemap-n.xml
sitemap https://www.tf1info.fr/sitemap.xml
sitemap https://www.tf1info.fr/sitemap-pages-0.xml

Comments

  • Robots.txt - www.tf1info.fr
  • .................''''''''''''''''''''',,,,,,,,;;;;;;;;;;;;::::::::::::::::::;::;;;;;;;;;;;;;;;;;,,,,,,,,,,''''''''...'dNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM
  • ................'''''''''''''''',',,,,,,,,,,,;;;;;;;;;;;;::::::::::::::::::;::;;;;;;;;;;;;;;;;;;;,,,,,,,,,,'''''''...'dNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM
  • ........,;:::::::cccccccccccccccccc;,,,,,,,,;;;;;;;:llllooooooooooooooooooolc;:;;;;;;;;;;;;;;;;;;,,,,,,;:;,''''''''..'dNMMMMMMMMMMWX0000000XWMMMMMMMMWX000000XWMMMMMMMMMMMNK000000KWMMMMMMMMWX0000000000000000000000KWMMMMMMMMMMMMWX0kxddddxkO0XWMMMMMMMMM
  • .......'dXNNNNNNNNNNNNNNNNNNNNNNNNXd,,,,,,,;;;;;;;:dXNNNNNNNNNNNNNNNNNNNNNNKo:::;;;;;;;;;;;;;;;;::lodkO0Kx;''''''''..'dNMMMMMMMMMMXc.......:KMMMMMMMMK:......,xNMMMMMMMMMWx.......;0MMMMMMMMXc......................;0MMMMMMMMWKxl;... ..';okXWMMMMM
  • .......'xWMMMMMMMMMMMMMMMMMMMMMMMMNd,,,,,,,;;;;;;;:dNMMMMMMMMMMMMMMMMMMMMMMXd::;;;;;;;;;;;;:oxkO0XNWWMMMWk;'''''''...'dNMMMMMMMMMMK; ;KMMMMMMMM0, .:OWMMMMMMMWd. 'OMMMMMMMMX: 'OMMMMMMNk:. .'lOWMMM
  • .......'xWMMMMMMMMMMMMMMMMMMMMMMMMNd,,,,,,,;;;;;;;:dNMMMMMMMMMMMMMMMMMMMMMMXd;;;;;;;;;;;;;,lKWMMMMMMMMMMWk;'''''''...'dNMMMMMMMMMMK; ;KMMMMMMMM0, .oKWMMMMMWd. 'OMMMMMMMMX: ,0MMMMWO;. .. .cKWM
  • .......'xWMMMMMMMMMMMMMMMMMMMMMMMMNd,,,,,,,;;;;;;;:dNMMMMMMMMMMMNKOOOOOOOOOxc''''''''''''''cKMMMMMMMMMMMWk,..........'dNMMMMMMMMMMK; ;KMMMMMMMM0, ,xNMMMMWd. 'OMMMMMMMMX: 'okkkkkkkkkkkkkONMMMNd. .:oxkOkxl;. ,kW
  • .......'xNWWWWWWMMMMMMMMMMMMWWWWWWXd,,,,,,,;;;;;;,,oNMMMMMMMMMMM0:...'''''''.......''''''''cKMMMMMMMMMMMWk,...........dNMMMMMMMMMMK; ;KMMMMMMMM0, .:0WMMWd. 'OMMMMMMMMX: ;KMMMMMMMMMMMMMMMMMWd. .oKWMMMMMMMN0c. 'O
  • ........;cccccoKMMMMMMMMMMMWOolllll:,'''...........cXMMMMMMMMMMMO;................'''''''''cKMMMMMMMMMMMWx,...........dNMMMMMMMMMMK; ;KMMMMMMMM0, .oXMWd. 'OMMMMMMMMX: ;KMMMMMMMMMMMMMMMMM0, 'kWMMMMMMMMMMMNd. :
  • ..............;OMMMMMMMMMMMWd'.......... .........cXMMMMMMMMMMMXkddddddl,...........''''''cKMMMMMMMMMMMWx,...........dNMMMMMMMMMMK; ;KMMMMMMMM0, ,kXo. 'OMMMMMMMMX: .ldddddddkXMMMMMMMWd. .oWMMMMMMMMMMMMMX: .
  • ..............;OMMMMMMMMMMMNo........ .........cXMMMMMMMMMMMMMMMMMMW0:.................cKMMMMMMMMMMMWx,...........dNMMMMMMMMMMK; ;KMMMMMMMM0, ,;. .:;. 'OMMMMMMMMX: 'OMMMMMMMWo. .xMMMMMMMMMMMMMMNo. .
  • ..............,kMMMMMMMMMMMNo....... .........cXMMMMMMMMMMMMMMMMMMM0:.................cKMMMMMMMMMMMWx,...........dNMMMMMMMMMMK; ;KMMMMMMMM0, .lXx,. 'OMMMMMMMMX: 'OMMMMMMMWd. .oWMMMMMMMMMMMMMXc .
  • ..............'kMMMMMMMMMMMNo..... .........cXMMMMMMMMMMMMMMMMMWW0:.................:KMMMMMMMMMMMWx,...........oNMMMMMMMMMMK; ;KMMMMMMMM0, .oNMXo. 'OMMMMMMMMX: ..''''''.:0MMMMMMMMO' 'OWMMMMMMMMMMMNd. ;
  • .........'kMMMMMMMMMMMNo... ........cXMMMMMMMMMMMXxooooooc'.................:KMMMMMMMMMMMWx,...........oNMMMMMMMMMMK; ;KMMMMMMMM0, .oWMMW0:. 'OMMMMMMMMX: ,OXXXXXXXNWMMMMMMMMNd. 'dXWMMMMMMMW0l. 'k
  • ......kMMMMMMMMMMMNo. .......cXMMMMMMMMMMMO;.........................:KMMMMMMMMMMMWx,...........oNMMMMMMMMMMK; ;KMMMMMMMM0, .oWMMMMNx,. 'OMMMMMMMMX: ;KMMMMMMMMMMMMMMMMMMNo. .'cdkO0Oko:. 'kW
  • .kWMMMMMMMMMMNo. .......cXMMMMMMMMMMMO;.........................:KMMMMMMMMMMMWx'...........oNMMMMMMMMMMK; ;KMMMMMMMM0, .lWMMMMMMKo. 'OMMMMMMMMX: ;KMMMMMMMMMMMMMMMMMMMNk;. ... .:0WM
  • .kMMMMMMMMMMMNo. ........cXMMMMMMMMMMMO;.........................:KMMMMMMMMMMMWx'...........oNMMMMMMMMMMK; ;KMMMMMMMM0, .lWMMMMMMMWO:. 'OMMMMMMMMX: ;KMMMMMMMMMMMMMMMMMMMMWXx;. .cONMMM
  • .xNWWWWWWWWNNXl. .......:KWWWWWWWWWWNO,.........................:0NWWWWWWWWWWNx'...........oNMMMMMMMMMMK:.......:KMMMMMMMM0;.......oWMMMMMMMMMNx,......,0MMMMMMMMXc.......:KMMMMMMMMMMMMMMMMMMMMMMMN0dc,.. ..;lxKWMMMMM
  • .';;;;;;;;;;;,. ........;:::::::::::;..........................';::c:::::::::,............oNMMMMMMMMMMWKOOOOOOOKWMMMMMMMMN0OOOOOOOXWMMMMMMMMMMWX0OOOOO0NMMMMMMMMWKOOOOOOOKWMMMMMMMMMMMMMMMMMMMMMMMMMMWNKOkddooodxk0XNMMMMMMMMM
  • .........................................................................oNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM
  • ..........................................................................oNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM
  • ..........................................................................oNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM