cravercam.com
robots.txt

Robots Exclusion Standard data for cravercam.com

Resource Scan

Scan Details

Site Domain cravercam.com
Base Domain cravercam.com
Scan Status Ok
Last Scan2025-11-24T06:02:07+00:00
Next Scan 2025-12-24T06:02:07+00:00

Last Scan

Scanned2025-11-24T06:02:07+00:00
URL https://cravercam.com/robots.txt
Domain IPs 104.21.44.29, 172.67.194.84, 2606:4700:3032::6815:2c1d, 2606:4700:3036::ac43:c254
Response IP 104.21.44.29
Found Yes
Hash 64224096189bab2c62789977aaadfb6d0b6a138366c2a074d452b5e6be207c8d
SimHash 495955c12283

Groups

*

Rule Path
Disallow /graph-api/*
Disallow /tools/*
Disallow /tags/*/ajax-pager
Disallow /check-auth
Disallow /get-authorization-token
Disallow /ping
Disallow /css/*
Disallow /ssnt
Disallow /refer-a-friend
Disallow /get-free-usernames
Disallow /interview-vote
Disallow /subscribe-online*
Disallow /unsubscribe-online*
Disallow /is-subscribed-online*
Disallow /chat-ajax*
Disallow /chat-translator*
Disallow /cybersale-ajax
Disallow /cybersale-get-coupons-count
Disallow /buffer-tips/*
Disallow /rit
Disallow /aet
Disallow /aetp
Disallow /aetc
Disallow /aetmp
Disallow /rue
Disallow /init-private-chat-rating
Disallow /save-private-chat-rating
Disallow /subscribe-site-push-notifications
Disallow /site-push-notifications/track
Disallow /api/*
Disallow /impressum
Disallow *search?=
Disallow /profile/*/follow/*
Disallow /get-member-chat-data
Disallow /popular-chat
Disallow /yoti-age-verification-button

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://cravercam.com/sitemap.xml