api.flickr.com
robots.txt
Robots Exclusion Standard data for api.flickr.com
Resource Scan
Scan Details
| Site Domain | api.flickr.com |
| Base Domain | flickr.com |
| Scan Status | Ok |
| Last Scan | 2024-09-19T23:15:29+00:00 |
| Next Scan | 2024-09-26T23:15:29+00:00 |
Last Scan
| Scanned | 2024-09-19T23:15:29+00:00 |
| URL | https://api.flickr.com/robots.txt |
| Domain IPs | 13.33.37.122, 2600:9000:229f:3e00:1b:3d3c:224a:1261, 2600:9000:229f:4000:1b:3d3c:224a:1261, 2600:9000:229f:5800:1b:3d3c:224a:1261, 2600:9000:229f:8c00:1b:3d3c:224a:1261, 2600:9000:229f:c000:1b:3d3c:224a:1261, 2600:9000:229f:c600:1b:3d3c:224a:1261, 2600:9000:229f:e400:1b:3d3c:224a:1261, 2600:9000:229f:f800:1b:3d3c:224a:1261 |
| Response IP | 13.33.37.122 |
| Found | Yes |
| Hash | 8dc009da207b3c0f8164733c70ef573cdc473932577a0e8208ad879a65826552 |
| SimHash | 6800c7806091 |
Groups
adsbot-google
alexabot
applebot
archive.org_bot
baiduspider
bitlybot
bingbot
bingpreview
coccocbot
discordbot
duckduckbot
facebookexternalhit
google-site-verification
google-sitemaps
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
gsa-crawler
hatenablog-bot
ia_archiver
mediapartners-google
msnbot
naver
petalbot
pingdom
pinterest
redditbot
slackbot
slurp
snapchat
twitterbot
wp.com
yandex
yandeximages
yandexvideoparser
yeti
zoombot
| Rule | Path |
|---|---|
| Disallow | /gp/ |
| Disallow | /report_abuse.gne |
| Disallow | /abuse |
| Disallow | /images/* |
| Disallow | /apps/* |
| Disallow | /tools/demos/* |
| Disallow | /search |
| Disallow | /services/oauth |
| Disallow | /groups/10millionphotos/ |
| Disallow | /photos/youpy/ |
| Disallow | /photos/i_love_u_get_away_from_me/ |
| Disallow | /faves-i_love_u_get_away_from_me/ |
| Disallow | /photos/gbachelie/ |
| Disallow | /photos/archivesact/6011019532/nearby/ |
| Disallow | /yss_fragment.gne |
| Disallow | /photos/tags/*/page* |
| Disallow | /photos/*/lightbox/ |
| Disallow | /groups/*/lightbox/ |
| Disallow | /explore/*/lightbox/ |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.flickr.com/sitemap/index/users/sitemap-index-users-00000000.xml.gz |
| sitemap | https://www.flickr.com/sitemap/index/tags/sitemap-index-tags-00000000.xml.gz |
| sitemap | https://www.flickr.com/sitemap/index/sets/sitemap-index-sets-00000000.xml.gz |
| sitemap | https://www.flickr.com/sitemap/index/photos/sitemap-index-photos-00000000.xml.gz |
| sitemap | https://www.flickr.com/sitemap/index/groups/sitemap-index-groups-00000000.xml.gz |