fox.com.tr
robots.txt

Robots Exclusion Standard data for fox.com.tr

Resource Scan

Scan Details

Site Domain fox.com.tr
Base Domain fox.com.tr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-08-23T07:55:52+00:00
Next Scan 2024-11-21T07:55:52+00:00

Last Successful Scan

Scanned2024-04-26T07:34:45+00:00
URL https://fox.com.tr/robots.txt
Redirect https://www.nowtv.com.tr/robots.txt
Redirect Domain www.nowtv.com.tr
Redirect Base nowtv.com.tr
Domain IPs 82.222.191.178
Response IP 176.235.92.171
Found Yes
Hash 2db6c8eef0e19f9f3c07886e867aee59c2c31af5f629bc897817c2b85fc24c1f
SimHash 605456425797

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow /

teoma

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

robozilla

Rule Path
Disallow

nutch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow

asterias

Rule Path
Disallow /

yahoo-blogs/v3.9

Rule Path
Disallow

dotbot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

bitlybot

Rule Path
Disallow /

twitterbot

Rule Path
Allow *

yandex

Rule Path
Allow *

*

Rule Path
Disallow /
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.nowtv.com.tr/sitemap.xml