Log In Sign Up

pneussthubert.com
robots.txt

Robots Exclusion Standard data for pneussthubert.com

Resource Scan

Scan Details

Site Domain pneussthubert.com
Base Domain pneussthubert.com
Scan Status Ok
Last Scan2026-03-01T13:48:21+00:00
Next Scan 2026-03-31T13:48:21+00:00

Last Scan

Scanned2026-03-01T13:48:21+00:00
URL https://pneussthubert.com/robots.txt
Domain IPs 144.217.76.152
Response IP 144.217.76.152
Found Yes
Hash 69a2f937f6ec15d80e3c05823f24494e521cde86f6e73f264709a432c8148468
SimHash 6b3d1d1bc786

Groups

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mail.ru_bot/2.0

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mail.ru_bot/2.0; +http://go.mail.ru/help/robots

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

tineye

Rule Path
Disallow /

tineye/1.0

Rule Path
Disallow /

tineye/1.1

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://pneussthubert.com/sitemap.xml
Back to top

Comments

  • robots.txt
  • Created: 01 / 01 / 2013 15:16:37 GMT
  • Please note: There are a lot of pages on this site, and there are
  • some misbehaved spiders out there. If you're
  • irresponsible, your access to the site may be blocked.
Back to top