vrdb.com
robots.txt
Robots Exclusion Standard data for vrdb.com
Resource Scan
Scan Details
| Site Domain | vrdb.com |
| Base Domain | vrdb.com |
| Scan Status | Ok |
| Last Scan | 4/13/2025, 9:35:53 AM |
| Next Scan | 4/20/2025, 9:35:53 AM |
Last Scan
| Scanned | 4/13/2025, 9:35:53 AM |
| URL | https://vrdb.com/robots.txt |
| Redirect | https://www.indiedb.com/robots.txt |
| Redirect Domain | www.indiedb.com |
| Redirect Base | indiedb.com |
| Domain IPs | 104.21.59.212, 172.67.184.20, 2606:4700:3031::ac43:b814, 2606:4700:3032::6815:3bd4 |
| Redirect IPs | 104.26.12.36, 104.26.13.36, 172.67.69.154, 2606:4700:20::681a:c24, 2606:4700:20::681a:d24, 2606:4700:20::ac43:459a |
| Response IP | 172.67.69.154 |
| Found | Yes |
| Hash | 4328dedfc448c770d1f354aa1e3e4bf76ef5be833b11cc49c2fb1b06441854b0 |
| SimHash | 26dcd27a0ec2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*? |
| Disallow | /*/ajax/ |
| Disallow | /*/blog/ |
| Disallow | /*/blogs/ |
| Disallow | /*/comments/ |
| Disallow | /*/add/ |
| Disallow | /*/edit/ |
| Disallow | /*/images/archive |
| Disallow | /*/page/ |
| Disallow | /*/stats/ |
| Disallow | /*/videos/archive |
| Disallow | /addons/start/ |
| Disallow | /admin |
| Disallow | /articles/ajax/ |
| Disallow | /blog |
| Disallow | /blogs |
| Disallow | /cart |
| Disallow | /comment |
| Disallow | /company/ajax/ |
| Disallow | /cutoff/html/ |
| Disallow | /downloads/ajax/ |
| Disallow | /downloads/mirror/ |
| Disallow | /downloads/start/ |
| Disallow | /downloads/timeout/ |
| Disallow | /external |
| Disallow | /features/ajax/ |
| Disallow | /forum/ajax/ |
| Disallow | /forum/shortcut/ |
| Disallow | /forum/search |
| Disallow | /games/ajax/ |
| Disallow | /groups/ajax/ |
| Disallow | /groups/gamefront/ |
| Disallow | /groups/indiedb/ |
| Disallow | /groups/moddb/ |
| Disallow | /groups/slidedb/ |
| Disallow | /groups/vrdb/ |
| Disallow | /home |
| Disallow | /hardware |
| Disallow | /media |
| Disallow | /members/ajax/ |
| Disallow | /members/logout/ |
| Disallow | /members/password/ |
| Disallow | /members/permission/ |
| Disallow | /messages |
| Disallow | /mods |
| Disallow | /newsletter/ajax/ |
| Disallow | /platforms |
| Disallow | /profile |
| Disallow | /reviews/ajax/ |
| Disallow | /search |
| Disallow | /software |
| Disallow | /staff |
| Disallow | /statistics |
| Disallow | /tags/ajax/ |
| Disallow | /tutorials/ajax/ |
mj12bot
ahrefsbot
semrushbot
dotbot
mauibot
petalbot
| Rule | Path |
|---|---|
| Disallow | /*? |
| Disallow | /*/ajax/ |
| Disallow | /*/blog/ |
| Disallow | /*/blogs/ |
| Disallow | /*/comments/ |
| Disallow | /*/add/ |
| Disallow | /*/edit/ |
| Disallow | /*/images/archive |
| Disallow | /*/page/ |
| Disallow | /*/stats/ |
| Disallow | /*/videos/archive |
| Disallow | /addons/start/ |
| Disallow | /admin |
| Disallow | /articles/ajax/ |
| Disallow | /blog |
| Disallow | /blogs |
| Disallow | /cart |
| Disallow | /comment |
| Disallow | /company/ajax/ |
| Disallow | /cutoff/html/ |
| Disallow | /downloads/ajax/ |
| Disallow | /downloads/mirror/ |
| Disallow | /downloads/start/ |
| Disallow | /downloads/timeout/ |
| Disallow | /external |
| Disallow | /features/ajax/ |
| Disallow | /forum/ajax/ |
| Disallow | /forum/shortcut/ |
| Disallow | /forum/search |
| Disallow | /games/ajax/ |
| Disallow | /groups/ajax/ |
| Disallow | /groups/gamefront/ |
| Disallow | /groups/indiedb/ |
| Disallow | /groups/moddb/ |
| Disallow | /groups/slidedb/ |
| Disallow | /groups/vrdb/ |
| Disallow | /home |
| Disallow | /hardware |
| Disallow | /media |
| Disallow | /members |
| Disallow | /messages |
| Disallow | /mods |
| Disallow | /newsletter/ajax/ |
| Disallow | /platforms |
| Disallow | /profile |
| Disallow | /reviews/ajax/ |
| Disallow | /search |
| Disallow | /software |
| Disallow | /staff |
| Disallow | /statistics |
| Disallow | /tags/ajax/ |
| Disallow | /tutorials/ajax/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.indiedb.com/api/siteindex |
| sitemap | https://www.indiedb.com/api/siteindex |