fotolia.de
robots.txt

Robots Exclusion Standard data for fotolia.de

Resource Scan

Scan Details

Site Domain fotolia.de
Base Domain fotolia.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-03T01:07:30+00:00
Next Scan 2025-01-01T01:07:30+00:00

Last Successful Scan

Scanned2022-08-09T12:25:51+00:00
URL http://fotolia.de/robots.txt
Redirect https://de.fotolia.com/robots.txt
Redirect Domain de.fotolia.com
Redirect Base fotolia.com
Response IP 54.247.171.225
Found Yes
Hash e7bbf3a066bad70a7f82b4d2fc9456c27a997f9551c8596466fbc6ad508b154d
SimHash 7e5c9b34ab93

Groups

*

Rule Path
Disallow /Ajax/
Disallow /DownloadContent/
Disallow /Content/CompImage/
Disallow /Content/Comp/
Disallow /AddToShoppingcart/
Disallow /Search/SwitchThumbnailSize
Disallow /Wikilia/
Disallow /Xmlrpc/
Disallow /Rest/
Disallow /Info/Release/View/
Disallow /Info/BuyCreditsChooseAmount/
Disallow /Info/SubscriptionFunnel/

charlotte

Rule Path
Disallow /

speedy

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ocelli

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

riddlerbot

Rule Path
Disallow /

linguatools

Rule Path
Disallow /

www.integromedb.org/crawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.