infosports.com
robots.txt

Robots Exclusion Standard data for infosports.com

Resource Scan

Scan Details

Site Domain infosports.com
Base Domain infosports.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-10T04:34:19+00:00
Next Scan 2024-12-09T04:34:19+00:00

Last Successful Scan

Scanned2024-05-13T15:50:11+00:00
URL https://infosports.com/robots.txt
Domain IPs 66.39.53.194
Response IP 66.39.53.194
Found Yes
Hash e758daaf15d397eed505ea6d3b4485eed42936a8667858834e0b1a053db6a7fb
SimHash 2151d2824714

Groups

googlebot
mediapartners-google
adsbot-google
googlebot-image
googlebot-mobile

Rule Path
Allow /

twitterbot

Rule Path
Allow /

applebot

Rule Path
Allow /

facebookexternalhit/1.1

Rule Path
Allow /

msnbot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

teoma

Rule Path
Allow /

robozilla

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

yahoo-mmcrawler

Rule Path
Allow /

psbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

yahoo-blogs/v3.9

Rule Path
Allow /

*

Rule Path
Disallow /