clicktrans.de
robots.txt

Robots Exclusion Standard data for clicktrans.de

Resource Scan

Scan Details

Site Domain clicktrans.de
Base Domain clicktrans.de
Scan Status Ok
Last Scan2024-11-11T16:16:39+00:00
Next Scan 2024-11-25T16:16:39+00:00

Last Scan

Scanned2024-11-11T16:16:39+00:00
URL https://clicktrans.de/robots.txt
Domain IPs 13.226.2.124, 13.226.2.33, 13.226.2.46, 13.226.2.82
Response IP 13.226.2.46
Found Yes
Hash 2a01f7ecaccdc2e72e26d4c6bd045820457ead302a1e56b5b010db0f578b2ad4
SimHash 6b251061e51d

Groups

*

Rule Path
Disallow /frontapp/
Allow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://clicktrans.pl/sitemap_pl/sitemap_pl.xml.gz
sitemap https://clicktrans.com/sitemap_com/sitemap_com.xml.gz
sitemap https://clicktrans.es/sitemap_es/sitemap_es.xml.gz
sitemap https://clicktrans.de/sitemap_de/sitemap_de.xml.gz
sitemap https://clicktrans.it/sitemap_it/sitemap_it.xml.gz
sitemap https://clicktrans.fr/sitemap_fr/sitemap_fr.xml.gz
sitemap https://clicktrans.pl/blog/sitemap.xml
sitemap https://clicktrans.com/blog/sitemap.xml
sitemap https://clicktrans.es/blog/sitemap.xml
sitemap https://clicktrans.de/blog/sitemap.xml