searchenginereports.net
robots.txt
Robots Exclusion Standard data for searchenginereports.net
Resource Scan
Scan Details
| Site Domain | searchenginereports.net |
| Base Domain | searchenginereports.net |
| Scan Status | Ok |
| Last Scan | 2024-11-13T18:37:36+00:00 |
| Next Scan | 2024-11-20T18:37:36+00:00 |
Last Scan
| Scanned | 2024-11-13T18:37:36+00:00 |
| URL | https://searchenginereports.net/robots.txt |
| Domain IPs | 104.26.12.90, 104.26.13.90, 172.67.73.248, 2606:4700:20::681a:c5a, 2606:4700:20::681a:d5a, 2606:4700:20::ac43:49f8 |
| Response IP | 104.26.12.90 |
| Found | Yes |
| Hash | d793b4e9769096a860ee4b478b638c8122b3914446053e7fb0c2368e410a967d |
| SimHash | 2b411a608b99 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /admin |
| Disallow | /cdn-cgi/* |
| Disallow | /get-content-from-url |
| Disallow | /expired-domains-tool/?page=11& |
| Disallow | /getzip |
| Disallow | /pro/email/verify |
| Disallow | /sync |
| Disallow | /make-credit-card |
| Disallow | /cart |
| Disallow | /gDrive-getFileAjax/ |
| Disallow | /ajaxrequests |
| Disallow | /ajaxrequests/getFromDropbox |
| Disallow | /ajaxrequests/getIpLoc |
| Disallow | /ajaxrequests/* |
| Disallow | /frontend/ajaxExternalFile |
| Disallow | /frontend/ajaxExternalFile/ |
| Disallow | /frontend/excel_report |
| Disallow | /frontend/cart |
| Disallow | /frontend/signup |
| Disallow | /frontend/webapp |
| Disallow | /frontend/orderstatus |
| Disallow | /frontend/elanceTest/ |
| Disallow | /frontend/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://searchenginereports.net/sitemap.xml |