Log In Sign Up

menupoint.net
robots.txt

Robots Exclusion Standard data for menupoint.net

Resource Scan

Scan Details

Site Domain menupoint.net
Base Domain menupoint.net
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-03-18T13:13:05+00:00
Next Scan 2024-06-16T13:13:05+00:00

Last Successful Scan

Scanned2022-10-27T07:42:11+00:00
URL https://www.menupoint.net/robots.txt
Response IP 18.181.31.166, 54.248.227.74
Found Yes
Hash bc083234c00124cea82c4386832183860503f29b7012701244bd21b7d2c954c3
SimHash b20d6fad6440

Groups

semrushbot

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.menupoint.net/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /
Back to top