mtbiker.pl
robots.txt

Robots Exclusion Standard data for mtbiker.pl

Resource Scan

Scan Details

Site Domain mtbiker.pl
Base Domain mtbiker.pl
Scan Status Ok
Last Scan2025-05-12T02:08:08+00:00
Next Scan 2025-05-26T02:08:08+00:00

Last Scan

Scanned2025-05-12T02:08:08+00:00
URL https://mtbiker.pl/robots.txt
Redirect https://www.mtbiker.pl/robots.txt
Redirect Domain www.mtbiker.pl
Redirect Base mtbiker.pl
Domain IPs 104.21.46.197, 172.67.141.169, 2606:4700:3030::ac43:8da9, 2606:4700:3035::6815:2ec5
Redirect IPs 104.21.46.197, 172.67.141.169, 2606:4700:3030::ac43:8da9, 2606:4700:3035::6815:2ec5
Response IP 104.21.46.197
Found Yes
Hash 10826f4f0e50d3333f7930236a93c0db1bf2402259c01186fabfef1f52664ec7
SimHash e100956f0d91

Groups

*

Rule Path
Allow /data/sitemap
Disallow /ajax
Disallow /external-click/
Disallow /data
Disallow /api

Other Records

Field Value
sitemap https://www.mtbiker.sk/data/sitemap/sitemap-index.xml