Log In Sign Up

technogps.com
robots.txt

Robots Exclusion Standard data for technogps.com

Resource Scan

Scan Details

Site Domain technogps.com
Base Domain technogps.com
Scan Status Ok
Last Scan2024-11-12T10:31:59+00:00
Next Scan 2024-11-19T10:31:59+00:00

Last Scan

Scanned2024-11-12T10:31:59+00:00
URL https://technogps.com/robots.txt
Domain IPs 46.105.204.2
Response IP 46.105.204.2
Found Yes
Hash 77226f1ac5935d5dff3c546887f8ecbf9efcf8b0f3d4ded34a1d4a5bd81bd332
SimHash 710bdc027eb0

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /search/
Disallow /*public_html/
Disallow /*index.php?

Other Records

Field Value
crawl-delay 30

semrushbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

feedburner

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.technogps.com/sitemap.xml
Back to top

Comments

  • Robots.txt generated by Booter - Crwalers Manager at Sat, 10 Feb 2024 10:42:41 +0000
  • Do not modify this file, any contents will be overwritten
  • Bloquer certains bots malveillants
Back to top