clicktrans.pl
robots.txt

Robots Exclusion Standard data for clicktrans.pl

Resource Scan

Scan Details

Site Domain clicktrans.pl
Base Domain clicktrans.pl
Scan Status Ok
Last Scan2024-09-10T16:07:34+00:00
Next Scan 2024-09-24T16:07:34+00:00

Last Scan

Scanned2024-09-10T16:07:34+00:00
URL https://clicktrans.pl/robots.txt
Domain IPs 3.160.196.100, 3.160.196.111, 3.160.196.20, 3.160.196.76
Response IP 13.226.2.45
Found Yes
Hash 2a01f7ecaccdc2e72e26d4c6bd045820457ead302a1e56b5b010db0f578b2ad4
SimHash 6b251061e51d

Groups

*

Rule Path
Disallow /frontapp/
Allow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://clicktrans.pl/sitemap_pl/sitemap_pl.xml.gz
sitemap https://clicktrans.com/sitemap_com/sitemap_com.xml.gz
sitemap https://clicktrans.es/sitemap_es/sitemap_es.xml.gz
sitemap https://clicktrans.de/sitemap_de/sitemap_de.xml.gz
sitemap https://clicktrans.it/sitemap_it/sitemap_it.xml.gz
sitemap https://clicktrans.fr/sitemap_fr/sitemap_fr.xml.gz
sitemap https://clicktrans.pl/blog/sitemap.xml
sitemap https://clicktrans.com/blog/sitemap.xml
sitemap https://clicktrans.es/blog/sitemap.xml
sitemap https://clicktrans.de/blog/sitemap.xml