barth-maschinenbau.de
robots.txt

Robots Exclusion Standard data for barth-maschinenbau.de

Resource Scan

Scan Details

Site Domain barth-maschinenbau.de
Base Domain barth-maschinenbau.de
Scan Status Ok
Last Scan2024-11-14T04:48:15+00:00
Next Scan 2024-12-14T04:48:15+00:00

Last Scan

Scanned2024-11-14T04:48:15+00:00
URL https://barth-maschinenbau.de/robots.txt
Domain IPs 138.201.145.23
Response IP 138.201.145.23
Found Yes
Hash 6cab5838d3375219c9b59b81123b5d95895dff02a4602400fb693c82a39524ae
SimHash 49d48fb24632

Groups

*

Rule Path
Disallow /dlm_uploads/

surveybot

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

jakarta commons-httpclient

Rule Path
Disallow /

aboutusbot

Rule Path
Disallow /

semager

Rule Path
Disallow /

linguee

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

gonzo

Rule Path
Disallow /

zeusbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes
Disallow /wp-content
Disallow /?page_id=9
Disallow /produkt/vmp/
Disallow /en/produkt/clamping-device-vakuusyst180/%26lt%3B/p%26gt%3B
Disallow /en/produkt/clamping-device-vakuusyst180/%26lt%3B/p%26gt%3B%26lt%3Bp%26gt%3Bhttp%3A/%26lt%3B/p%26gt%3B%26lt%3Bp%26gt%3B
Allow /wp-content/uploads
Allow /wp-content/themes
Allow /wp-content/cache
Disallow /wordpress/xmlrpc.php

*

Rule Path
Disallow /wp-content/themes/barth/clicks/

Other Records

Field Value
sitemap https://www.barth-maschinenbau.de/sitemap.xml