web-dialog.com
robots.txt

Robots Exclusion Standard data for web-dialog.com

Resource Scan

Scan Details

Site Domain web-dialog.com
Base Domain web-dialog.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-12-19T23:25:22+00:00
Next Scan 2026-01-02T23:25:22+00:00

Last Successful Scan

Scanned2025-12-03T00:33:23+00:00
URL https://web-dialog.com/robots.txt
Domain IPs 79.174.92.100
Response IP 79.174.92.100
Found Yes
Hash baec249ac5a05e3e731cfe9a7669b26042e14cd3cf596a76df46ca96825bb677
SimHash 001c5c436ec1

Groups

*

Rule Path
Disallow /whats-new/
Disallow /latest-activity/
Disallow /account/
Disallow /attachments/
Disallow /goto/
Disallow /login/
Disallow /search/
Disallow /admin.php
Disallow /members/
Allow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

Other Records

Field Value
sitemap https://web-dialog.com/sitemap.php