archive-pdf.fr
robots.txt

Robots Exclusion Standard data for archive-pdf.fr

Resource Scan

Scan Details

Site Domain archive-pdf.fr
Base Domain archive-pdf.fr
Scan Status Ok
Last Scan2026-02-04T00:34:08+00:00
Next Scan 2026-03-06T00:34:08+00:00

Last Scan

Scanned2026-02-04T00:34:08+00:00
URL https://archive-pdf.fr/robots.txt
Redirect https://www.archive-pdf.fr/robots.txt
Redirect Domain www.archive-pdf.fr
Redirect Base archive-pdf.fr
Domain IPs 13.37.6.18
Redirect IPs 104.21.13.162, 172.67.156.201, 2606:4700:3031::ac43:9cc9, 2606:4700:3036::6815:da2
Response IP 172.67.156.201
Found Yes
Hash febb216c4daf970f7930ee85a9a6bafc817dec75954f453b68362fbf90cb3042
SimHash 617cdc52cc11

Groups

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

brandverity

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.archive-pdf.fr/sitemap.xml