perplexity.ai
robots.txt

Robots Exclusion Standard data for perplexity.ai

Resource Scan

Scan Details

Site Domain perplexity.ai
Base Domain perplexity.ai
Scan Status Ok
Last Scan2025-07-17T15:03:05+00:00
Next Scan 2025-07-31T15:03:05+00:00

Last Scan

Scanned2025-07-17T15:03:05+00:00
URL https://perplexity.ai/robots.txt
Redirect https://www.perplexity.ai/robots.txt
Redirect Domain www.perplexity.ai
Redirect Base perplexity.ai
Domain IPs 104.18.26.48, 104.18.27.48, 2606:4700::6812:1a30, 2606:4700::6812:1b30
Redirect IPs 104.18.26.48, 104.18.27.48, 2606:4700::6812:1a30, 2606:4700::6812:1b30
Response IP 104.18.26.48
Found Yes
Hash 0a368f5b428299e5547ed961940b4c8add32e6e6314c115a81c21a8a7da64b92
SimHash 411900664516

Groups

*

Rule Path
Disallow /*?*q=
Disallow /search/new
Disallow /search?*%2F
Disallow /socket.io/
Disallow /onboarding/
Disallow /join/
Allow /academic
Allow /enterprise
Allow /finance
Allow /hub
Allow /podcast
Allow /pro
Allow /shopping
Allow /travel

googlebot

Rule Path
Disallow /*?*q=
Disallow /search*
Disallow /search?*%2F
Disallow /socket.io/
Disallow /onboarding/
Disallow /join/
Allow /academic
Allow /enterprise
Allow /finance
Allow /hub
Allow /podcast
Allow /pro
Allow /shopping
Allow /travel

Other Records

Field Value
sitemap https://www.perplexity.ai/sitemap.xml

Comments

  • https://www.robotstxt.org/robotstxt.html