Log In Sign Up

rajpay.com
robots.txt

Robots Exclusion Standard data for rajpay.com

Resource Scan

Scan Details

Site Domain rajpay.com
Base Domain rajpay.com
Scan Status Ok
Last Scan2025-10-02T18:24:35+00:00
Next Scan 2025-10-09T18:24:35+00:00

Last Scan

Scanned2025-10-02T18:24:35+00:00
URL https://rajpay.com/robots.txt
Domain IPs 190.92.174.109
Response IP 190.92.174.109
Found Yes
Hash 3d490fecd47178fe9dca8514a95e17d4db57a3b99ffc0476caf5f5187ff2002b
SimHash e94741d26dc1

Groups

*

Rule Path
Disallow /admin/
Disallow /backend/
Disallow /login/
Disallow /register/
Disallow /user-settings/
Disallow /*?*
Disallow /test/
Disallow /staging/
Disallow /draft/
Disallow /Sheet.aspx
Disallow /dmca-validation.html
Allow /IncomeTaxCalculator.aspx
Allow /PensionCalculator.aspx
Allow /SII.aspx
Allow /Default.aspx
Allow /Raj-Calendar-2025.aspx
Allow /Home-Loan-Calculator.aspx
Allow /Contact.aspx
Allow /About.aspx
Allow /Privacy.aspx
Allow /How-To-Create-G2G-SSO.aspx
Allow /Bank-Holiday-Calendar.aspx
Allow /PayMatrix.aspx
Allow /8th-Pay-Salary-Calculator.aspx
Allow /8th-Pay-Calculator-Central.aspx
Disallow /scripts/
Disallow /temp/
Back to top

Other Records

Field Value
sitemap https://rajpay.com/sitemap.xml
Back to top

Comments

  • Allow all search engines to crawl the site, but exclude sensitive areas
  • Block admin-related areas
  • Block dynamic query parameters (optional, if not needed for indexing)
  • Allow only specific calculators if they're critical for SEO
  • Allow access to essential content
  • Block unused scripts or resources (if unnecessary for SEO)
  • Sitemap for better crawling
Back to top