ciclism.ro
robots.txt

Robots Exclusion Standard data for ciclism.ro

Resource Scan

Scan Details

Site Domain ciclism.ro
Base Domain ciclism.ro
Scan Status Ok
Last Scan2025-10-09T23:54:27+00:00
Next Scan 2025-10-10T23:54:27+00:00

Last Scan

Scanned2025-10-09T23:54:27+00:00
URL https://ciclism.ro/robots.txt
Redirect https://www.ciclism.ro/robots.txt
Redirect Domain www.ciclism.ro
Redirect Base ciclism.ro
Domain IPs 104.21.16.151, 172.67.213.167, 2606:4700:3032::ac43:d5a7, 2606:4700:3037::6815:1097
Redirect IPs 104.21.16.151, 172.67.213.167, 2606:4700:3032::ac43:d5a7, 2606:4700:3037::6815:1097
Response IP 104.21.16.151
Found Yes
Hash e8c6416abeb089455778d60f64c43f076e5545ca2e1de99c53bc06e12fb1a900
SimHash 5864d6518c82

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /search/
Disallow /forums/topic/
Disallow /forums/profile/
Disallow /forums/index.php
Disallow /en/
Disallow /mobile/
Disallow /forums/search/
Disallow /forums/login/
Disallow /forums/register/
Disallow /forums/misc/cookies/
Disallow /forums/forum/
Disallow /forums/leaderboard/
Disallow /forums/pastleaders/
Disallow /forums/lostpassword/
Disallow /forums/calendar/
Disallow /forum/
Disallow /forums/attachments/
Allow /

rogerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ciclism.ro/sitemap.xml
sitemap https://www.ciclism.ro/sitemap.rss