Log In Sign Up

app.pvadeals.com
robots.txt

Robots Exclusion Standard data for app.pvadeals.com

Resource Scan

Scan Details

Site Domain app.pvadeals.com
Base Domain pvadeals.com
Scan Status Ok
Last Scan2026-02-07T00:54:08+00:00
Next Scan 2026-03-09T00:54:08+00:00

Last Scan

Scanned2026-02-07T00:54:08+00:00
URL https://app.pvadeals.com/robots.txt
Domain IPs 13.33.45.115, 13.33.45.24, 13.33.45.55, 13.33.45.78, 2600:9000:229f:3600:7:111e:5c00:93a1, 2600:9000:229f:4200:7:111e:5c00:93a1, 2600:9000:229f:6000:7:111e:5c00:93a1, 2600:9000:229f:a600:7:111e:5c00:93a1, 2600:9000:229f:b000:7:111e:5c00:93a1, 2600:9000:229f:c400:7:111e:5c00:93a1, 2600:9000:229f:dc00:7:111e:5c00:93a1, 2600:9000:229f:de00:7:111e:5c00:93a1
Response IP 13.33.45.115
Found Yes
Hash bf4e0054c380f02c68aae04588737be6106bc17ad4e938a7987da26fb541e1ea
SimHash a110f692e641

Groups

*

Rule Path
Disallow /client/
Disallow /admin/
Disallow /customer/
Disallow /signup
Disallow /set-password
Disallow /forgot-password
Disallow /verify-account
Disallow /logout
Disallow /api/
Disallow /graphql

googlebot-image

Rule Path
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.png$
Allow /*.gif$
Allow /*.webp$

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /
Back to top

Comments

  • PRODUCTION robots.txt for PVADeals Web App
  • Use this file for: app.pvadeals.com
  • Allow all search engines to crawl public pages
  • Disallow all user account and admin pages
  • Disallow authentication pages
  • Disallow API endpoints
  • Prevent crawling of media/assets if needed
  • Disallow: /static/
  • Disallow: /assets/
  • Allow Google Image Bot to crawl images
  • Block bad bots (optional)
Back to top