Log In Sign Up

itipteam.com
robots.txt

Robots Exclusion Standard data for itipteam.com

Resource Scan

Scan Details

Site Domain itipteam.com
Base Domain itipteam.com
Scan Status Ok
Last Scan2026-03-03T06:27:57+00:00
Next Scan 2026-04-02T06:27:57+00:00

Last Scan

Scanned2026-03-03T06:27:57+00:00
URL https://itipteam.com/robots.txt
Domain IPs 104.21.11.156, 172.67.166.98, 2606:4700:3031::6815:b9c, 2606:4700:3031::ac43:a662
Response IP 172.67.166.98
Found Yes
Hash 57819261084b133ef35c0006dba6b68c96919a60768f59286cb9697a343cfbf7
SimHash f05afdc4aa8a

Groups

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

vebot

Rule Path
Disallow /

barkrowler/0.9

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

gowikibot

Rule Path
Disallow /

gowikibot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

lumtelbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

adsbot-google

Rule Path
Allow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1.0

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5.0

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5.0

*

Rule Path
Disallow /cgi-bin
Disallow /?author=*
Disallow /search/
Disallow /?s=
Disallow /page/*/?s=
Disallow /wp-json/
Disallow /?rest_route=
Disallow /*?add_to_wishlist=
Disallow /wp-login.php
Disallow /wp-admin/

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://itipteam.com/sitemap_index.xml
Back to top

Comments

  • http://www.opensiteexplorer.org/dotbot
  • https://www.semrush.com/bot/
  • https://www.seokicks.de/robot.htm
  • http://webmeup-crawler.com/
  • http://ltx71.com/
  • https://velen.io/
  • https://www.ve.com/vebot
  • https://babbar.tech/crawler
  • https://www.zoominfo.com/
  • http://www.gowikibot.com/
  • https://cliqz.com/en/cliqzbot
  • https://lumtel.com/
  • https://suite.seozoom.it/bot.html
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top