Log In Sign Up

tx.group
robots.txt

Robots Exclusion Standard data for tx.group

Resource Scan

Scan Details

Site Domain tx.group
Base Domain tx.group
Scan Status Ok
Last Scan2024-11-14T18:24:48+00:00
Next Scan 2024-11-21T18:24:48+00:00

Last Scan

Scanned2024-11-14T18:24:48+00:00
URL https://tx.group/robots.txt
Domain IPs 104.18.10.42, 104.18.11.42, 2606:4700::6812:a2a, 2606:4700::6812:b2a
Response IP 104.18.11.42
Found Yes
Hash c9f93a5044aa182b4cb803bc8d1b915d82c9520c618c3b87e4ba436298db3360
SimHash eb495a9c9373

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /t3lib/
Disallow /typo3/
Disallow /typo3_src/
Disallow /typo3versions/
Disallow /typo3conf/
Allow /typo3/sysext/frontend/Resources/Public/*
Allow /typo3temp/
Allow /typo3conf/scharlachrot_theme/Ressources/Public/

googlebot

Rule Path
Disallow /cgi-bin/
Disallow /t3lib/
Disallow /typo3/
Disallow /typo3_src/
Disallow /typo3versions/
Disallow /typo3conf/
Allow /typo3/sysext/frontend/Resources/Public/*
Allow /typo3temp/
Allow /typo3conf/scharlachrot_theme/Ressources/Public/

slurp

Rule Path
Disallow /cgi-bin/
Disallow /t3lib/
Disallow /typo3/
Disallow /typo3_src/
Disallow /typo3versions/
Disallow /typo3conf/
Allow /typo3/sysext/frontend/Resources/Public/*
Allow /typo3temp/
Allow /typo3conf/scharlachrot_theme/Ressources/Public/

mediapartners-google*

Rule Path
Allow /*.php$
Allow /*.js$
Allow /*.inc$
Allow /*.css$
Allow /*.gz$
Allow /*.cgi$
Allow /*.wmv$
Allow /*.cgi$
Allow /*.xhtml$
Allow /*.php*
Allow /*.gif$
Allow /*.jpg$
Allow /*.png$
Back to top

Other Records

Field Value
sitemap https://tx.group/sitemap.xml
Back to top

Comments

  • Google Crawler
  • Yahoo! Crawler
  • allow adsense bot on entire site
Back to top