Log In Sign Up

askfm.site
robots.txt

Robots Exclusion Standard data for askfm.site

Resource Scan

Scan Details

Site Domain askfm.site
Base Domain askfm.site
Scan Status Ok
Last Scan2024-11-14T20:42:05+00:00
Next Scan 2024-11-21T20:42:05+00:00

Last Scan

Scanned2024-11-14T20:42:05+00:00
URL https://askfm.site/robots.txt
Redirect https://ask.fm/robots.txt
Redirect Domain ask.fm
Redirect Base ask.fm
Domain IPs 193.138.77.140, 193.138.77.141, 193.138.77.142, 193.138.77.143, 193.138.77.144, 193.138.77.145, 193.138.77.146, 193.138.77.147
Redirect IPs 193.138.77.140, 193.138.77.141, 193.138.77.142, 193.138.77.143, 193.138.77.144, 193.138.77.145, 193.138.77.146, 193.138.77.147
Response IP 193.138.77.144
Found Yes
Hash 8062f69f38e3e49e227be4dc110026d504e4c73f11472fdf7f3fe6dac08cc3cd
SimHash a2944d8d6550

Groups

*

Rule Path
Disallow /account
Disallow /track/*

baiduspider

Rule Path
Disallow /
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top