pdf.io
robots.txt

Robots Exclusion Standard data for pdf.io

Resource Scan

Scan Details

Site Domain pdf.io
Base Domain pdf.io
Scan Status Ok
Last Scan2024-06-22T05:42:09+00:00
Next Scan 2024-06-29T05:42:09+00:00

Last Scan

Scanned2024-06-22T05:42:09+00:00
URL https://pdf.io/robots.txt
Domain IPs 104.21.37.123, 172.67.208.27, 2606:4700:3034::6815:257b, 2606:4700:3037::ac43:d01b
Response IP 104.21.37.123
Found Yes
Hash cd24d6ebd5fadd562e648b8e0658a5b44f7ae4740e189584eda4a6d2674f78c7
SimHash 490c0d429f12

Groups

*

Rule Path
Disallow /*?*
Allow /*.css
Allow /*.js
Allow /*.jpg
Allow /*.png
Allow /*.svg

googlebot

Rule Path
Disallow /*?*
Allow /*.css
Allow /*.js
Allow /*.jpg
Allow /*.png
Allow /*.svg

Other Records

Field Value
sitemap https://pdf.io/sitemap.xml