freesectools.com
robots.txt

Robots Exclusion Standard data for freesectools.com

Resource Scan

Scan Details

Site Domain freesectools.com
Base Domain freesectools.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-11-12T03:52:33+00:00
Next Scan 2024-11-26T03:52:33+00:00

Last Successful Scan

Scanned2024-10-27T09:11:12+00:00
URL https://freesectools.com/robots.txt
Domain IPs 34.88.108.171
Response IP 34.88.108.171
Found Yes
Hash ddb4996b29530e85156d0a4b97fb4a6c88daa09da8b36d8c9d380f5b93d3864a
SimHash 9851eb328f03

Groups

*

Rule Path
Allow /
Disallow /edit_blog
Disallow /login
Disallow /add_blog

Other Records

Field Value
sitemap https://freesectools.com/sitemap.xml

Comments

  • Allow all pages except the ones specified below
  • Disallow admin and login pages
  • Sitemap URL (if available)