Log In Sign Up

fichier-pdf.fr
robots.txt

Robots Exclusion Standard data for fichier-pdf.fr

Resource Scan

Scan Details

Site Domain fichier-pdf.fr
Base Domain fichier-pdf.fr
Scan Status Ok
Last Scan2024-11-12T01:14:01+00:00
Next Scan 2024-11-19T01:14:01+00:00

Last Scan

Scanned2024-11-12T01:14:01+00:00
URL https://fichier-pdf.fr/robots.txt
Redirect https://www.fichier-pdf.fr/robots.txt
Redirect Domain www.fichier-pdf.fr
Redirect Base fichier-pdf.fr
Domain IPs 13.37.6.18
Redirect IPs 51.158.61.217
Response IP 51.158.61.217
Found Yes
Hash b77c3f6885750af912558a5ca00b1fb6b89f6f235535f7836eb4a4984c7d2c45
SimHash 521c5840ec11

Groups

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

brandverity

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

isec_bot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow /telecharger/
Back to top

Other Records

Field Value
sitemap https://www.fichier-pdf.fr/sitemap.xml
Back to top