s-media-cache-ak0.pinimg.com
robots.txt

Robots Exclusion Standard data for s-media-cache-ak0.pinimg.com

Resource Scan

Scan Details

Site Domain s-media-cache-ak0.pinimg.com
Base Domain pinimg.com
Scan Status Ok
Last Scan2024-09-13T15:14:09+00:00
Next Scan 2024-10-13T15:14:09+00:00

Last Scan

Scanned2024-09-13T15:14:09+00:00
URL https://s-media-cache-ak0.pinimg.com/robots.txt
Redirect https://i.pinimg.com/robots.txt
Redirect Domain i.pinimg.com
Redirect Base pinimg.com
Domain IPs 151.101.0.84, 151.101.128.84, 151.101.192.84, 151.101.64.84, 2a04:4e42:200::84, 2a04:4e42:400::84, 2a04:4e42:600::84, 2a04:4e42::84
Redirect IPs 23.215.7.14, 23.215.7.15, 23.215.7.18, 23.215.7.21, 23.215.7.23, 23.215.7.25, 23.215.7.29, 23.215.7.30, 23.215.7.32, 2a04:4e42:200::84, 2a04:4e42:400::84, 2a04:4e42:600::84, 2a04:4e42::84
Response IP 151.101.108.84
Found Yes
Hash 5079250c334f8ae7182428faaeb3fda67f70f053304f0aa6d130a10586d921ee
SimHash e854da02a257

Groups

googlebot-image

Rule Path
Disallow /*nii%3Dt

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Comments

  • https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers