headline.mtfj.net
robots.txt
Robots Exclusion Standard data for headline.mtfj.net
Resource Scan
Scan Details
Site Domain | headline.mtfj.net |
Base Domain | mtfj.net |
Scan Status | Ok |
Last Scan | 2024-06-14T08:08:42+00:00 |
Next Scan | 2024-07-14T08:08:42+00:00 |
Last Scan
Scanned | 2024-06-14T08:08:42+00:00 |
URL | https://headline.mtfj.net/robots.txt |
Domain IPs | 157.112.183.3 |
Response IP | 157.112.183.3 |
Found | Yes |
Hash | bfe6cd722a2c315c78fd4315cbf62bfa0d90c12d133fd3474eeb01b818c2fc14 |
SimHash | 651d4c64c911 |
Groups
*
Rule | Path |
---|---|
Disallow | /topics.php |
Disallow | /topics_safe.php |
Disallow | /feed/ |
Disallow | /m/ |
Disallow | /a/ |
Other Records
Field | Value |
---|---|
sitemap | https://headline.mtfj.net/sitemap.xml |