raptortech.com
robots.txt
Robots Exclusion Standard data for raptortech.com
Resource Scan
Scan Details
| Site Domain | raptortech.com |
| Base Domain | raptortech.com |
| Scan Status | Ok |
| Last Scan | 2024-11-06T00:41:34+00:00 |
| Next Scan | 2024-11-20T00:41:34+00:00 |
Last Scan
| Scanned | 2024-11-06T00:41:34+00:00 |
| URL | https://raptortech.com/robots.txt |
| Domain IPs | 141.193.213.20, 141.193.213.21 |
| Response IP | 141.193.213.21 |
| Found | Yes |
| Hash | 8dfee9a9f9282c1a2bc408b9b8ba38387e7516b6818bd9bfab03a87a9752693a |
| SimHash | 6328544076a3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-includes/ |
| Disallow | /wp-admin/ |
| Disallow | /bx_slider/ |
| Disallow | /wp-includes/ |
| Disallow | /home_slider/ |
| Disallow | /whitepapers/ |
| Disallow | /employees/ |
| Disallow | /tag/ |
| Disallow | /page/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
*
| Rule | Path |
|---|---|
| Disallow | /wp-content/uploads/wp-import-export-lite/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://raptortech.com/page-sitemap.xml |
Comments