rapidsearch.app
robots.txt

Robots Exclusion Standard data for rapidsearch.app

Resource Scan

Scan Details

Site Domain rapidsearch.app
Base Domain rapidsearch.app
Scan Status Ok
Last Scan2025-10-03T10:40:09+00:00
Next Scan 2025-11-02T10:40:09+00:00

Last Scan

Scanned2025-10-03T10:40:09+00:00
URL https://rapidsearch.app/robots.txt
Redirect https://www.rapidsearch.app/robots.txt
Redirect Domain www.rapidsearch.app
Redirect Base rapidsearch.app
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 13.203.125.58, 13.233.175.166, 3.109.243.18
Response IP 13.233.175.166
Found Yes
Hash 6f33c59d32bff1562213148fd3b3643ab8dceb2616257f5753d36e09966956fa
SimHash 59148852c511

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /editor/
Disallow /dashboard/
Disallow /cms/

gptbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

ccbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.rapidsearch.app/sitemap.xml