Log In Sign Up

photos18.com
robots.txt

Robots Exclusion Standard data for photos18.com

Resource Scan

Scan Details

Site Domain photos18.com
Base Domain photos18.com
Scan Status Ok
Last Scan2024-05-23T16:02:24+00:00
Next Scan 2024-06-22T16:02:24+00:00

Last Scan

Scanned2024-05-23T16:02:24+00:00
URL https://photos18.com/robots.txt
Redirect https://www.photos18.com/robots.txt
Redirect Domain www.photos18.com
Redirect Base photos18.com
Domain IPs 104.21.57.24, 172.67.158.102, 2606:4700:3031::ac43:9e66, 2606:4700:3032::6815:3918
Redirect IPs 104.21.57.24, 172.67.158.102, 2606:4700:3031::ac43:9e66, 2606:4700:3032::6815:3918
Response IP 104.21.57.24
Found Yes
Hash 78951f696add8d374230f83f4ec7149a5d653c537335e62fae407b3a464f91cf
SimHash 6a70750593b6

Groups

googlebot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

bingbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

baiduspider

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

sosospider

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

slurp

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

msnbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

yandexbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

sogou

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

facebookexternalhit

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

twitterbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

linkedinbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

embedly

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

quora link preview

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

showyoubot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

outbrain

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

pinterest

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

developers.google.com

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

slackbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

vkshare

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

w3c_validator

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

whatsapp

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

flipboard

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

tumblr

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

bitlybot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

skypeuripreview

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

nuzzel

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

discordbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

google page speed

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

google web preview

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

google-read-aloud

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

google favicon

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

google search console

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

google-structured-data-testing-tool

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

google-amp-cache

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

google-adwords

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

google-adwords-keyword-planner

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

mediapartners-google

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

adsbot-google

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */images/

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.photos18.com/sitemap/index
Back to top

Warnings

  • 4 invalid lines.
Back to top