Log In Sign Up

1netzteil.de
robots.txt

Robots Exclusion Standard data for 1netzteil.de

Resource Scan

Scan Details

Site Domain 1netzteil.de
Base Domain 1netzteil.de
Scan Status Ok
Last Scan2024-06-28T01:42:47+00:00
Next Scan 2024-07-28T01:42:47+00:00

Last Scan

Scanned2024-06-28T01:42:47+00:00
URL https://1netzteil.de/robots.txt
Domain IPs 92.205.175.248
Response IP 92.205.175.248
Found Yes
Hash 4d0ceaf5a667a6f9a18596dadd75f39dd0c6be4b85cdc5f5b3ddb4bffc0b5603
SimHash b8161559c954

Groups

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

baiduspider-render

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://1netzteil.de/sitemaps/de-sitemap-master.xml
sitemap https://1netzteil.de/blog/sitemap.xml
Back to top

Comments

  • robots.txt automatically generated by PrestaShop e-commerce open-source solution
  • http://www.prestashop.com - http://www.prestashop.com/forums
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • Files
Back to top