validusgrp.com
robots.txt
Robots Exclusion Standard data for validusgrp.com
Resource Scan
Scan Details
| Site Domain | validusgrp.com |
| Base Domain | validusgrp.com |
| Scan Status | Ok |
| Last Scan | 2025-09-03T20:11:23+00:00 |
| Next Scan | 2025-09-17T20:11:23+00:00 |
Last Scan
| Scanned | 2025-09-03T20:11:23+00:00 |
| URL | https://validusgrp.com/robots.txt |
| Domain IPs | 104.18.26.14, 104.18.27.14, 2606:4700::6812:1a0e, 2606:4700::6812:1b0e |
| Response IP | 104.18.26.14 |
| Found | Yes |
| Hash | 228878d2b9be4d0834d226a765d504e6c23de949c286c496e1010b4a8a62bd3e |
| SimHash | f71dd166f586 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /author/* |
| Disallow | /%5D/ |
| Disallow | /liftoff/ |
| Disallow | /zh-hans/ |
| Disallow | /?s=* |
| Disallow | /tag/* |
| Disallow | */feed/ |
| Disallow | */feed/rss2/ |
| Disallow | /?p=* |
| Disallow | /?post_type=post&p=* |
| Disallow | /date-posted/* |
| Disallow | */login |
| Disallow | /application-expiry/* |
| Disallow | /?post_type=awsm_job_openings&p=* |
| Disallow | /?ref=* |
| Disallow | /search/* |
| Disallow | /?rname=SICCI-Helps |
| Disallow | /sff2018/ |
| Disallow | /sctf |
| Disallow | /lift/ |
| Disallow | /361dc/ |
| Disallow | /fha2018/ |
| Disallow | /sfa/ |
| Disallow | /afs2019-referral/ |
| Disallow | /afs2019/ |
| Disallow | /privacy-policy/ |
| Disallow | /?firebase-messaging-sw |
| Disallow | /sff* |
| Disallow | /sme-business-account-2/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://validusgrp.com/sitemap_index.xml |