freeimages.com
robots.txt

Robots Exclusion Standard data for freeimages.com

Resource Scan

Scan Details

Site Domain freeimages.com
Base Domain freeimages.com
Scan Status Ok
Last Scan2024-10-21T20:49:37+00:00
Next Scan 2024-11-20T20:49:37+00:00

Last Scan

Scanned2024-10-21T20:49:37+00:00
URL https://freeimages.com/robots.txt
Domain IPs 108.157.254.41, 108.157.254.76, 108.157.254.82, 108.157.254.90
Response IP 108.157.254.82
Found Yes
Hash 106e002136d4f4796de83dc8fee2c1bf225372004c18370350940d1acbfa9624
SimHash 005cc5412f53

Groups

*

Rule Path
Disallow /accounts
Disallow /admin
Disallow /campaign
Disallow /captcha
Disallow /common
Disallow /download
Disallow /editor
Disallow /images/external
Disallow /favorite
Disallow /get
Disallow /mailing
Disallow /more
Disallow /my
Disallow /relaunch
Disallow /istockphoto
Disallow /translate
Disallow /images/screenshots
Allow /

ahrefsbot
dotbot
exabot
gigabot
ia_archiver
mj12bot
blexbot
semrushbot
semrushbot-sa

Rule Path
Disallow /

applebot

Rule Path
Disallow /istockphoto/file
Allow /

Warnings

  • 1 invalid line.