Log In Sign Up

infogym.net
robots.txt

Robots Exclusion Standard data for infogym.net

Resource Scan

Scan Details

Site Domain infogym.net
Base Domain infogym.net
Scan Status Ok
Last Scan2024-11-12T03:00:52+00:00
Next Scan 2024-11-19T03:00:52+00:00

Last Scan

Scanned2024-11-12T03:00:52+00:00
URL https://infogym.net/robots.txt
Domain IPs 46.105.204.2
Response IP 46.105.204.2
Found Yes
Hash a579a59d5d0191f45c04ddf0d631759321378e1e4296eb483cfddd41f85037e9
SimHash 21039402ef94

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin
Disallow /*public_html/
Disallow /*index.php?

Other Records

Field Value
crawl-delay 30

semrushbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.infogym.net/sitemap.xml
Back to top

Comments

  • Robots.txt generated by Booter - Crwalers Manager at Mon, 12 Feb 2024 20:37:00 +0000
  • Do not modify this file, any contents will be overwritten
Back to top