seocompany.me
robots.txt
Robots Exclusion Standard data for seocompany.me
Resource Scan
Scan Details
| Site Domain | seocompany.me |
| Base Domain | seocompany.me |
| Scan Status | Ok |
| Last Scan | 2024-06-30T07:14:43+00:00 |
| Next Scan | 2024-07-30T07:14:43+00:00 |
Last Scan
| Scanned | 2024-06-30T07:14:43+00:00 |
| URL | https://seocompany.me/robots.txt |
| Domain IPs | 34.149.120.3, 34.160.81.203, 35.190.31.54, 35.227.194.51 |
| Response IP | 35.190.31.54 |
| Found | Yes |
| Hash | b583e25de55aa47e823566e3c7c2587832b589205e1e28aa710b48ae19391a06 |
| SimHash | c059ceb2aafb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /project-view/project-testing/ |
| Disallow | /delhi-ncr |
| Disallow | /seo-services |
| Disallow | /duplicate-test-web-development/ |
| Disallow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
httrack disallow /
httrack disallow: /
netcaptor disallow /
netcaptor disallow: /
offline explorer disallow /
offline explorer disallow: /
spiderku/0.9 disallow /
spiderku/0.9 disallow: /
steeler disallow /
steeler disallow: /
webcopier v3.3 disallow /
webcopier v3.3 disallow: /
webcopier v3.2a disallow /
webcopier v3.2a disallow: /
webcopier disallow /
webcopier disallow: /
web downloader/4.9 disallow /
web downloader/4.9 disallow: /
web downloader/5.8 disallow /
web downloader/5.8 disallow: /
webgather 3.0 disallow /
webgather 3.0 disallow: /
webstripper/2.56 disallow /
webstripper/2.56 disallow: /
webzip/3.65 disallow /
webzip/3.65 disallow: /
webzip disallow /
webzip disallow: /
wget disallow /
wget disallow: /
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.seocompany.me/sitemap.xml |
Warnings
- 2 invalid lines.