sportiw.com
robots.txt

Robots Exclusion Standard data for sportiw.com

Resource Scan

Scan Details

Site Domain sportiw.com
Base Domain sportiw.com
Scan Status Ok
Last Scan2024-11-04T05:39:43+00:00
Next Scan 2024-11-11T05:39:43+00:00

Last Scan

Scanned2024-11-04T05:39:43+00:00
URL https://sportiw.com/robots.txt
Domain IPs 104.21.47.138, 172.67.171.77, 2606:4700:3030::ac43:ab4d, 2606:4700:3037::6815:2f8a
Response IP 172.67.171.77
Found Yes
Hash e025e30f761d8991fb931a280c5b2d949af6671026ccc3cacbbaa09e60182731
SimHash 4518b964a132

Groups

*

Rule Path
Allow /athletes/*.*/*
Allow /coaches/*.*/*
Allow /agents/*.*/*
Allow /others/*.*/*
Allow /camps/*.*/*
Allow /federations/*
Disallow /api/athletes/*/get_stats_data
Disallow /api/athletes/*/hand/get_stats_data
Disallow /athletes
Allow /offers/*
Disallow /offers
Allow /coach_offers/*
Disallow /coach_offers
Disallow /chat
Disallow /contacts
Disallow /users
Disallow /marketplace
Disallow /camps
Disallow /agents
Disallow /coaches
Disallow /verification
Disallow /nova
Disallow /login
Disallow /fr/login
Disallow /en/login
Disallow /es/login
Disallow /register
Disallow /fr/register
Disallow /en/register
Disallow /es/register

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sportiw.com/sitemap/sitemap.xml