topsolid.com
robots.txt

Robots Exclusion Standard data for topsolid.com

Resource Scan

Scan Details

Site Domain topsolid.com
Base Domain topsolid.com
Scan Status Ok
Last Scan2024-09-26T18:42:11+00:00
Next Scan 2024-10-26T18:42:11+00:00

Last Scan

Scanned2024-09-26T18:42:11+00:00
URL https://topsolid.com/robots.txt
Redirect https://www.topsolid.com/robots.txt
Redirect Domain www.topsolid.com
Redirect Base topsolid.com
Domain IPs 159.180.233.206
Redirect IPs 159.180.233.206
Response IP 159.180.233.206
Found Yes
Hash ad89682b05a56e9c9cc670d642e1a80bf413a7b5327042fbf9907e39829ccfd2
SimHash eb14b042f1f9

Groups

*

Rule Path Comment
Allow / Allow bot to enter

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

trident

Rule Path
Disallow /

presto

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

mqqbrowser

Rule Path
Disallow /

mb2345browser

Rule Path
Disallow /

ucbrowser

Rule Path
Disallow /

ucbrowser/

Rule Path
Disallow /

tencenttraveler

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ubermetrics

Rule Path
Disallow /

micromessenger

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

the world

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

bingbot

Rule Path Comment
Disallow /fileadmin/contents Exclude only folders with no
Disallow /fileadmin/contenus -
Disallow /fileadmin/dev -
Disallow /fileadmin/download -
Disallow /fileadmin/news_import -
Disallow /fileadmin/templates -
Disallow /fileadmin/user_upload -
Disallow /fileadmin/_migrated -
Disallow /fileadmin/user_upload -
Disallow /fileadmin/media -
Disallow /t3lib/ Nothing to see here
Disallow /typo3/ Nothing to see here
Disallow /typo3conf/ Nothing to see here
Disallow /typo3temp/ Nothing to see here
Disallow /*?id=* Disable non-realurl
Disallow /*%26type%3D98 Disable print pages
Disallow /*?chash=* -
Disallow /*?cHash=* -

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.topsolid.com/en/sitemap.xml
sitemap https://www.topsolid.com/fr-fr/sitemap.xml

Warnings

  • 2 invalid lines.