serpapi.org
robots.txt

Robots Exclusion Standard data for serpapi.org

Resource Scan

Scan Details

Site Domain serpapi.org
Base Domain serpapi.org
Scan Status Ok
Last Scan2026-03-04T12:18:55+00:00
Next Scan 2026-03-11T12:18:55+00:00

Last Scan

Scanned2026-03-04T12:18:55+00:00
URL https://serpapi.org/robots.txt
Domain IPs 104.21.78.109, 172.67.220.98, 2606:4700:3036::ac43:dc62, 2606:4700:3037::6815:4e6d
Response IP 104.21.78.109
Found Yes
Hash 6978f578af0cfc6a93d61c811932d26f2d13e856aef1bb79a2bbc443c9ae4f9d
SimHash fc1446d62451

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /search/
Disallow /image/
Disallow /videos/
Disallow /news/
Disallow /shopping/
Disallow /coupons/
Disallow /stores/
Disallow /demo-api
Disallow /playground
Disallow /dashboard
Disallow /admin/
Disallow /profile
Allow /
Allow /serp-api
Allow /web-search-api
Allow /image-search-api
Allow /video-search-api
Allow /news-search-api
Allow /pricing
Allow /contact
Allow /privacy
Allow /demo

Other Records

Field Value
sitemap https://serpapi.org/sitemap.xml

Comments

  • Disallow API endpoints
  • Disallow dynamic search result pages
  • Disallow tool/demo pages (will have noindex meta tags)
  • Explicitly allow SEO landing pages