digitalguider.com
robots.txt
Robots Exclusion Standard data for digitalguider.com
Resource Scan
Scan Details
Site Domain | digitalguider.com |
Base Domain | digitalguider.com |
Scan Status | Ok |
Last Scan | 2025-09-08T08:07:11+00:00 |
Next Scan | 2025-10-08T08:07:11+00:00 |
Last Scan
Scanned | 2025-09-08T08:07:11+00:00 |
URL | https://digitalguider.com/robots.txt |
Domain IPs | 104.26.2.17, 104.26.3.17, 172.67.71.253, 2606:4700:20::681a:211, 2606:4700:20::681a:311, 2606:4700:20::ac43:47fd |
Response IP | 104.26.2.17 |
Found | Yes |
Hash | 27c22b69fd0cb6f8b8e7bd10a7b0ed17966e09d12cd01f5319e1bc453476b062 |
SimHash | d803d843e8db |
Groups
*
Rule | Path | Comment |
---|---|---|
Disallow | /wp-admin/ | - |
Disallow | /wp-login.php | - |
Disallow | /?s= | - |
Disallow | /search/ | - |
Disallow | /cgi-bin/ | - |
Disallow | /wp-json/ | - |
Disallow | /trackback/ | - |
Disallow | /feed/ | - |
Disallow | /comments/feed/ | - |
Disallow | /wp-content/plugins/ | - |
Disallow | /assets/js/ | - |
Disallow | /rss/ | - |
Disallow | /*?replytocom | - |
Disallow | /*.pdf$ | If you donâââ‰â¢t want PDFs indexed |
Disallow | /*?utm_source | - |
Allow | /wp-admin/admin-ajax.php | - |
Other Records
Field | Value |
---|---|
sitemap | https://digitalguider.com/sitemap_index.xml |
Comments