Log In Sign Up

wagroupz.com
robots.txt

Robots Exclusion Standard data for wagroupz.com

Resource Scan

Scan Details

Site Domain wagroupz.com
Base Domain wagroupz.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-11T09:10:30+00:00
Next Scan 2025-01-09T09:10:30+00:00

Last Successful Scan

Scanned2024-06-14T09:08:17+00:00
URL https://wagroupz.com/robots.txt
Redirect https://www.wagroupz.com/robots.txt
Redirect Domain www.wagroupz.com
Redirect Base wagroupz.com
Domain IPs 104.21.28.96, 172.67.145.81, 2606:4700:3036::6815:1c60, 2606:4700:3037::ac43:9151
Redirect IPs 104.21.28.96, 172.67.145.81, 2606:4700:3036::6815:1c60, 2606:4700:3037::ac43:9151
Response IP 172.67.145.81
Found Yes
Hash 18855fa36d86b3a9fc0f5959c650a6e8a9dde95005e5cf9165a87b41d0f88a6a
SimHash 290005774d44

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /group/join?id=*
Disallow /search?q=*
Back to top

Other Records

Field Value
sitemap https://www.wagroupz.com/sitemap.xml
sitemap https://www.wagroupz.com/sitemap/groups/3.xml
sitemap https://www.wagroupz.com/sitemap/page.xml
Back to top

Comments

  • Allow Mediapartners-Google to access the entire site for displaying ads.
  • Restrict certain pages to generic crawlers, but allow access to the rest of the site.
  • Sitemap for search engine crawlers.
Back to top