Log In Sign Up

funapptools.s325.xrea.com
robots.txt

Robots Exclusion Standard data for funapptools.s325.xrea.com

Resource Scan

Scan Details

Site Domain funapptools.s325.xrea.com
Base Domain xrea.com
Scan Status Ok
Last Scan2025-10-15T16:18:42+00:00
Next Scan 2025-11-14T16:18:42+00:00

Last Scan

Scanned2025-10-15T16:18:42+00:00
URL http://funapptools.s325.xrea.com/robots.txt
Redirect http://funapptools.com/robots.txt
Redirect Domain funapptools.com
Redirect Base funapptools.com
Domain IPs 160.251.151.147
Redirect IPs 160.251.151.147
Response IP 160.251.151.147
Found Yes
Hash 3b6ecdf6c583d6236f70f4c64bfc4b77562e109783d3e40ee87895902f58b543
SimHash bc353d710ce6

Groups

google-adstxt

Rule Path
Disallow
Back to top

Comments

  • This robots.txt file controls crawling of URLs under https://example.com.
  • All crawlers are disallowed to crawl files in the "includes" directory, such
  • as .css, .js, but Google needs them for rendering, so Googlebot is allowed
  • to crawl them.
Back to top