fotolia.com
robots.txt

Robots Exclusion Standard data for fotolia.com

Resource Scan

Scan Details

Site Domain fotolia.com
Base Domain fotolia.com
Scan Status Ok
Last Scan2024-09-17T05:12:57+00:00
Next Scan 2024-10-17T05:12:57+00:00

Last Scan

Scanned2024-09-17T05:12:57+00:00
URL https://fotolia.com/robots.txt
Redirect https://www.fotolia.com/robots.txt
Redirect Domain www.fotolia.com
Redirect Base fotolia.com
Domain IPs 34.240.231.155, 54.247.171.225, 63.32.69.250
Redirect IPs 34.240.231.155, 54.247.171.225, 63.32.69.250
Response IP 54.247.171.225
Found Yes
Hash e7bbf3a066bad70a7f82b4d2fc9456c27a997f9551c8596466fbc6ad508b154d
SimHash 7e5c9b34ab93

Groups

*

Rule Path
Disallow /Ajax/
Disallow /DownloadContent/
Disallow /Content/CompImage/
Disallow /Content/Comp/
Disallow /AddToShoppingcart/
Disallow /Search/SwitchThumbnailSize
Disallow /Wikilia/
Disallow /Xmlrpc/
Disallow /Rest/
Disallow /Info/Release/View/
Disallow /Info/BuyCreditsChooseAmount/
Disallow /Info/SubscriptionFunnel/

charlotte

Rule Path
Disallow /

speedy

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ocelli

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

riddlerbot

Rule Path
Disallow /

linguatools

Rule Path
Disallow /

www.integromedb.org/crawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.