sfltimes.com
robots.txt

Robots Exclusion Standard data for sfltimes.com

Resource Scan

Scan Details

Site Domain sfltimes.com
Base Domain sfltimes.com
Scan Status Ok
Last Scan2024-11-09T21:07:47+00:00
Next Scan 2024-11-16T21:07:47+00:00

Last Scan

Scanned2024-11-09T21:07:47+00:00
URL https://sfltimes.com/robots.txt
Redirect https://www.sfltimes.com/robots.txt
Redirect Domain www.sfltimes.com
Redirect Base sfltimes.com
Domain IPs 162.144.83.177
Redirect IPs 162.144.83.177
Response IP 162.144.83.177
Found Yes
Hash 62c54e0fa1265a1920098354b8425576f5ecb94e7ea0eb65910d4240be53b0d7
SimHash a9d06fba5652

Groups

adsbot-google

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

msnptc

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow

asterias

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /api/
Disallow /wp-includes/
Disallow /wp-content/themes/

Other Records

Field Value
sitemap http://www.sfltimes.com/sitemap.xml
sitemap http://www.sfltimes.com/sitemap-image.xml

Comments

  • allow the Google Adwords link checker
  • allow the MSN Adcenter link checker