Log In Sign Up

gopickle.ai
robots.txt

Robots Exclusion Standard data for gopickle.ai

Resource Scan

Scan Details

Site Domain gopickle.ai
Base Domain gopickle.ai
Scan Status Ok
Last Scan2025-10-23T22:53:12+00:00
Next Scan 2025-11-22T22:53:12+00:00

Last Scan

Scanned2025-10-23T22:53:12+00:00
URL https://gopickle.ai/robots.txt
Domain IPs 104.21.11.204, 172.67.192.159, 2606:4700:3033::6815:bcc, 2606:4700:3036::ac43:c09f
Response IP 104.21.11.204
Found Yes
Hash 451ee019a1beacc0e456ef32c5f216817bf7172cfeca2821433427b282633eee
SimHash e5009f512565

Groups

*

Rule Path
Allow /
Disallow /hire-photographer
Disallow /studio/
Disallow /legal/
Disallow /doc/
Disallow /album/
Disallow /album-download
Disallow /verify-links
Disallow /album-not-found
Disallow /document-not-found
Disallow /*?*
Back to top

Other Records

Field Value
sitemap https://gopickle.ai/sitemap.xml
Back to top

Comments

  • Robots.txt for Pickle - Photography Business Platform
  • https://gopickle.ai
  • Allow all crawlers to access the entire site
  • Disallow private/admin areas
  • Disallow client-specific album pages (private content)
  • Disallow verification and utility pages
  • Disallow error pages from being indexed
  • Disallow search result pages with parameters
  • Sitemap location
  • Crawl delay (optional - adjust based on server capacity)
  • Crawl-delay: 1
Back to top