dev.prepostseo.com
robots.txt
Robots Exclusion Standard data for dev.prepostseo.com
Resource Scan
Scan Details
| Site Domain | dev.prepostseo.com |
| Base Domain | prepostseo.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2026-01-25T19:37:46+00:00 |
| Next Scan | 2026-04-25T19:37:46+00:00 |
Last Successful Scan
| Scanned | 2023-09-14T18:19:26+00:00 |
| URL | https://dev.prepostseo.com/robots.txt |
| Domain IPs | 104.26.6.130, 104.26.7.130, 172.67.70.42, 2606:4700:20::681a:682, 2606:4700:20::681a:782, 2606:4700:20::ac43:462a |
| Response IP | 104.26.6.130 |
| Found | Yes |
| Hash | 131d5b9b490a8918d9a9f803e0a4a94f9e79d9ced24669cf7d0b1887dd9077d8 |
| SimHash | 6dd150040788 |
Groups
*
googlebot
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /advertise |
| Disallow | /cart/* |
| Disallow | /apis/* |
| Disallow | /?ref= |
| Disallow | /fbclid%3D |
| Disallow | /?page= |
| Disallow | /?url= |
| Disallow | /?aff_id=* |
| Disallow | /?rewriter= |
| Disallow | /?source= |
| Disallow | /?a=* |
| Disallow | /?utm_source=* |
| Disallow | /mode%3D |
| Disallow | /cdn-cgi/ |
| Disallow | /?fl_rand_seed= |
| Disallow | /?q= |
| Disallow | /?rel= |
| Disallow | /ajax/ |
| Disallow | /frontend/* |
| Disallow | /blog/page/* |
| Disallow | /compare/* |
| Disallow | /res/* |
| Disallow | /calculator/* |
| Disallow | /checkSiteStatus.php |
| Disallow | /cdn-cgi/l/email-protection |
| Disallow | /aggregate |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.prepostseo.com/blogposts.xml |
| sitemap | http://www.prepostseo.com/sitemap/tools |