Log In Sign Up

cupra-forum.com
robots.txt

Robots Exclusion Standard data for cupra-forum.com

Resource Scan

Scan Details

Site Domain cupra-forum.com
Base Domain cupra-forum.com
Scan Status Ok
Last Scan2026-03-19T10:18:49+00:00
Next Scan 2026-03-26T10:18:49+00:00

Last Scan

Scanned2026-03-19T10:18:49+00:00
URL https://cupra-forum.com/robots.txt
Domain IPs 195.201.136.177, 2a01:4f8:1c1c:7840::1
Response IP 195.201.136.177
Found Yes
Hash 6e28bf4b05be97862b55a09011c32d661cad71465cb5d0cd866df8a5ee3aaae9
SimHash c11c9840a480

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

*

Rule Path
Disallow /acp/
Disallow /wcf/
Disallow /core/
Disallow /filebase/
Disallow /calendar/
Disallow /login/
Disallow /register/
Disallow /search/
Disallow /user-post-list/
Disallow /tagged/

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /
Allow /easymedia/
Disallow /easymedia/ajax/
Disallow /easymedia/player/

awariobot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

imagesiftbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

claude-searchbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

serankingbacklinksbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /login/
Disallow /register/

petalbot

Rule Path
Disallow /members-list/
Disallow /user/
Back to top

Other Records

Field Value
sitemap https://cupra-forum.com/sitemaps/sitemap.xml
Back to top