incrob.com
robots.txt
Robots Exclusion Standard data for incrob.com
Resource Scan
Scan Details
Site Domain | incrob.com |
Base Domain | incrob.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-08-18T13:19:23+00:00 |
Next Scan | 2025-08-25T13:19:23+00:00 |
Last Successful Scan
Scanned | 2025-08-03T05:20:51+00:00 |
URL | https://incrob.com/robots.txt |
Domain IPs | 3.165.102.114, 3.165.102.126, 3.165.102.127, 3.165.102.96 |
Response IP | 3.165.102.127 |
Found | Yes |
Hash | b953ec12bc31198eae007f103aec57dfb5ca4c38a45e7a81b31677582939195e |
SimHash | 6849da70edf3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /site_join |
Disallow | /site_join_agree |
Disallow | /login |
Disallow | /logout.cm |
Disallow | /shop_cart |
Disallow | /?mode* |
*
Rule | Path |
---|---|
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://incrob.com/sitemap.xml |