blogs.perficient.com
robots.txt
Robots Exclusion Standard data for blogs.perficient.com
Resource Scan
Scan Details
| Site Domain | blogs.perficient.com |
| Base Domain | perficient.com |
| Scan Status | Ok |
| Last Scan | 2024-10-29T03:58:25+00:00 |
| Next Scan | 2024-11-28T03:58:25+00:00 |
Last Scan
| Scanned | 2024-10-29T03:58:25+00:00 |
| URL | https://blogs.perficient.com/robots.txt |
| Domain IPs | 130.250.210.45 |
| Response IP | 130.250.210.45 |
| Found | Yes |
| Hash | ed7d296b17a02982b0e914b4290c8b7b41ec5c3ee90624f6feea5a8d62371380 |
| SimHash | e32ada44ce25 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /partnermicrosoft/ |
| Disallow | /partneribm/ |
| Disallow | /partneroracle/ |
| Disallow | /allposts/ |
| Disallow | *social_controller%3Dauth* |
| Disallow | *powerpress_pinw* |
| Disallow | *repeat%3Dw3tc* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
gsa-crawler
| Rule | Path |
|---|---|
| Disallow | */page/* |
| Disallow | */tag/* |
| Disallow | */category/* |
| Disallow | *social_controller%3Dauth* |
| Disallow | *powerpress_pinw* |
| Disallow | *repeat%3Dw3tc* |
| Disallow | *?s=* |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /wp-content/uploads/wp-import-export-lite/ |
Comments